-- Logs begin at Mon 2022-08-29 21:50:30 UTC, end at Mon 2022-08-29 23:01:40 UTC. -- Aug 29 22:32:15.741792 dv-cinder-854270-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:32:15.753785 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:32:15 2022] *** Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: nodename: dv-cinder-854270-4-iscsi Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: machine: x86_64 Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: clock source: unix Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: pcre jit disabled Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: detected number of CPU cores: 4 Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: current working directory: / Aug 29 22:32:15.756501 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: your processes number limit is 47680 Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: your memory page size is 4096 bytes Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: detected max file descriptor number: 2048 Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: lock engine: pthread robust mutexes Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: thunder lock: enabled Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:32:15.757405 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:32:15.810976 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: Python main interpreter initialized at 0x556fc42889c0 Aug 29 22:32:15.810976 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: python threads support enabled Aug 29 22:32:15.810976 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: your server socket listen backlog is limited to 100 connections Aug 29 22:32:15.810976 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:32:15.811407 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:32:15.811487 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: *** Operational MODE: preforking *** Aug 29 22:32:15.811787 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:32:15.811787 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: spawned uWSGI master process (pid: 133478) Aug 29 22:32:15.812011 dv-cinder-854270-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:32:15.816371 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: spawned uWSGI worker 1 (pid: 133479, cores: 1) Aug 29 22:32:15.816371 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: spawned uWSGI worker 2 (pid: 133480, cores: 1) Aug 29 22:32:15.816371 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:32:16.503629 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:32:16.513148 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:32:17.613396 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:32:17.613396 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: from cryptography.utils import int_from_bytes Aug 29 22:32:17.614057 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:32:17.614057 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: from cryptography.utils import int_from_bytes Aug 29 22:32:17.614468 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:32:17.614468 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: from cryptography.utils import int_from_bytes Aug 29 22:32:17.615020 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:32:17.615020 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: from cryptography.utils import int_from_bytes Aug 29 22:32:20.211200 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:32:20.211978 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:32:20.213067 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:32:20.213729 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:32:20.214185 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:32:20.214861 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.215203 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.215528 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.215926 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.216185 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.216494 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.216840 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.217141 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.217476 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.217736 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.218065 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.218371 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-4-iscsi {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.218691 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.219027 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.219338 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.219659 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.219958 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.220285 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.220581 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.221081 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.221543 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.221856 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.222169 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.222515 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.222845 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.223155 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.223392 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:32:20.223972 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.224074 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:32:20.224155 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.224155 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.224286 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:32:20.224500 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.224718 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:32:20.224857 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:32:20.224949 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-4-iscsi {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.225444 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.225561 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.225724 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.225861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226053 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226156 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226156 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226370 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226455 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226531 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226680 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.226825 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227024 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227114 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227384 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227553 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227857 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.227990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228152 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228265 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228345 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228420 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228608 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228740 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-4-iscsi {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.228940 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229069 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229221 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229318 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229527 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229750 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.229842 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230003 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230154 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230301 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230427 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230625 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.230790 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.231113 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.231304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.231464 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.231653 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232130 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232274 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232377 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232637 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232737 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232921 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.232921 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233324 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233435 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233556 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233642 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233847 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.233947 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234069 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234192 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234192 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234524 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234617 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.234819 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235014 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235134 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235221 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235301 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235475 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235576 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-4-iscsi {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.235922 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.236016 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.236879 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237017 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237017 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237281 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237513 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237656 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237831 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.237831 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.238489 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.238627 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.238804 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239010 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239156 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239248 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239393 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239482 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239613 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239699 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239809 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239892 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.239892 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240105 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240198 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240281 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240418 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240518 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240589 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240820 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.240969 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.241151 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.241416 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.241518 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.241778 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.241880 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.242002 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.242724 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243405 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243595 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243725 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243855 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243949 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.243949 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244147 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244242 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244335 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244335 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244567 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244653 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244784 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244879 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.244879 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245087 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245183 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245265 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245354 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245560 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245677 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.245860 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246146 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246243 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246451 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246575 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246870 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.246972 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247118 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247243 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247387 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247581 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247674 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.247977 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.248106 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.248380 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.248478 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.248618 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.249388 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250194 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250293 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250443 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250533 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250663 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250781 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250781 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.250998 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251093 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251176 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251306 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251428 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251555 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251640 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251732 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.251908 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.252122 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.252549 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.252637 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.252864 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.253047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.253353 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.253564 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.253900 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.254105 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.254436 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.254545 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.254774 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.254976 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.255201 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.255488 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.255702 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.255823 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.255995 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.256121 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.256682 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.256838 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.257000 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.257318 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.257502 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.257702 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.257868 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.258017 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.258238 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.258451 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.259403 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.259560 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.259717 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.259888 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260000 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260127 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260318 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260532 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260653 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.260901 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.261059 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.261208 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.261496 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.261699 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.261889 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.262151 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.262283 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.262593 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.262780 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.262923 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.263215 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.263366 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.263536 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.264015 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.264217 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.264447 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.264576 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.264773 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.265068 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.265217 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.265512 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.265651 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.265847 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.266098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.266240 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.266382 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.266633 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.266791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.266962 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.267260 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.267389 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.267567 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.267898 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.268025 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.268262 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.268400 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.268576 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.268707 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.269019 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.269214 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.269359 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.269678 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.269824 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.269982 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.270296 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.270413 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.270596 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.270927 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.271024 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.271230 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.271455 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.271546 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.271822 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.272014 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.272122 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.272402 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.272566 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.272710 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.273029 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.273160 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.273418 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.273674 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.273793 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.274025 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.274931 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.275040 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:32:20.275252 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.275418 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.275594 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.275956 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.276048 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.276326 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.276549 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.276695 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.276972 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.277139 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.277290 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.277599 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.277699 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.277906 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.278233 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.278390 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.278615 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.278869 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.279031 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.279281 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.279424 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.279594 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.279915 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.280068 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.280323 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.280506 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.280645 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.280855 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.281101 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.281249 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.281460 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.281648 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.281785 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.282081 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.282204 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.282433 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.282803 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.282922 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.283170 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.283375 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.283512 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.283733 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.283833 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.284063 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.284200 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.284412 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.284677 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285036 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285275 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285374 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285374 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285558 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285650 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.285949 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.286126 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.286257 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.286570 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.286887 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.286993 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.287238 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.287383 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.287625 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.287731 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.287934 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.288064 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.288242 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.288393 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.288549 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.288890 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289001 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289178 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289286 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289507 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289613 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289849 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.289947 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.290160 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.290260 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.290469 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.290653 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.290802 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291066 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291265 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291447 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291577 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291785 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.291990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.292225 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.292300 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.292597 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.292729 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.292934 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.293074 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.293212 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.293514 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.293614 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.293831 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294096 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294186 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294464 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294560 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294815 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.294996 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.295161 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.295410 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.295519 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.295718 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.295813 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.296209 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.296378 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.296475 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.296598 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.296796 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297063 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297193 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297632 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297750 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297854 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.297984 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.298250 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.298673 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299206 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299286 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299379 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299451 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299528 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299604 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299672 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.299843 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.300041 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.300217 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.300419 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.300783 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.300873 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.301251 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.301354 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.301671 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.301902 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.302009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.302309 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.302482 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.302715 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.302868 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303075 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303174 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303387 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303508 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303717 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.303818 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304047 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304163 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304369 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304483 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304676 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304779 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.304998 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305304 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305426 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305653 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305764 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.305959 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306057 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306261 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306367 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306571 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306720 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.306890 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307030 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307181 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307398 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307559 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307703 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.307866 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308073 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308272 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308433 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308578 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308778 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.308901 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309117 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309210 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309479 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309584 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309800 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.309890 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310194 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310479 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310580 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310833 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.310932 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311138 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311279 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311475 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311614 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311836 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.311972 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.312237 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.312387 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.312600 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.312738 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.312881 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313177 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313296 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313440 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313563 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313659 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.313805 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314159 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314335 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314483 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314773 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.314919 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315329 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315441 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315616 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315749 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315870 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.315994 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.316195 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.316416 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.316602 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.316922 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.317013 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.317238 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.317491 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.317618 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.317860 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318067 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318275 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318508 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318644 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318846 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.318986 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.319141 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.319450 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.319666 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.319786 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.320042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.320144 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.320369 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.320675 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.320834 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.321596 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.321710 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.321905 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.322067 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.322220 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.322921 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.323163 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.323320 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.323505 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.323709 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.323883 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324077 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324254 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324409 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324588 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324769 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.324971 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.325116 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.325305 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.325550 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.325550 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.325916 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326124 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326316 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326503 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326693 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326866 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.326866 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.327249 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.327461 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.327461 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.327787 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.327989 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.328184 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.328524 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.328685 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.328854 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.328854 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.329196 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.329386 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.329597 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.329729 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.329862 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330001 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330154 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330305 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330305 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330595 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330747 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.330882 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331028 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331028 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331290 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331431 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331431 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331753 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.331941 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332109 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332297 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332432 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332568 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332700 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332846 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.332846 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.333115 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.333434 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.333640 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.333792 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.333944 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334090 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334226 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334365 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334533 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334679 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.334843 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335019 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335152 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335336 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335643 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335795 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.335959 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.336092 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.336321 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.336516 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.336723 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.337385 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.337519 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.337782 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.337928 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.338118 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.338267 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.338439 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.338583 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.338870 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.339153 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.339311 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.339540 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.339709 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.339856 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.340153 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.340299 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.340456 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.340771 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.340887 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.341157 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.341365 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.341460 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.341763 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.341999 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.342343 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.342560 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.342811 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.344758 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.344959 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.345103 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.345210 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.345406 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346148 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346289 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346406 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346573 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346573 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.346947 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347132 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347132 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347368 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347454 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347552 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347638 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347638 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347858 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.347974 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348117 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348268 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348422 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348604 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348604 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.348882 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349019 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349133 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349237 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349493 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349493 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349782 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349905 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.349905 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350168 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350323 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350442 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350665 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350665 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.350937 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351080 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351200 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351347 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351468 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351562 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351562 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351827 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.351990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.352211 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.352379 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.352591 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.352901 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.352994 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.353251 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.353399 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.353577 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.353817 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354004 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354168 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354352 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354512 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354714 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.354889 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.355040 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.355345 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.355619 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.355799 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.355955 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.356093 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.356310 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.356459 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.356637 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.356938 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357115 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357269 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357381 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357592 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357682 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.357897 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358004 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358194 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358289 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358500 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358794 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.358904 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.359114 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.359329 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.359419 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.359724 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.359834 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.360026 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.360278 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.360379 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.360685 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.360863 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.361005 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.361317 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.361408 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.361619 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.361915 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362004 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362211 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362438 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362533 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362799 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.362896 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.363198 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.363307 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.363451 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.363650 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.363827 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.364015 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.364193 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.364412 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.364645 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.364819 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.365009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.365223 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.365469 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.365686 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.365901 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366191 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366344 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366464 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366464 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366726 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.366726 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367060 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367060 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367347 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367484 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367639 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367786 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.367955 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368086 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368230 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368350 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368471 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368640 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368738 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368821 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368915 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.368998 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369136 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369136 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369383 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369508 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369598 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369682 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369817 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.369931 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.370254 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.370425 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.370576 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.370823 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.370920 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371182 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371333 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371482 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371614 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371761 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.371906 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372053 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372481 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372621 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372757 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.372941 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373035 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373243 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373351 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373563 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373739 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.373902 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.374159 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.374316 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.374502 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.374771 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.374912 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.375134 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.375311 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.375432 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.375730 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.375888 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376031 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376269 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376370 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376592 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376684 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.376909 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377023 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377225 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377319 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377537 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377704 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.377863 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378002 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378128 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378291 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378433 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378704 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.378911 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379044 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379136 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379340 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379439 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379658 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379760 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.379974 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380064 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380280 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380396 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380586 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380708 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.380887 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.381033 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.381200 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.381351 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.381754 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.381880 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382007 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382158 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382302 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382432 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382595 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382692 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.382979 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.383135 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.383280 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.383423 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384193 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384287 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384420 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384517 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384647 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384758 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.384919 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385065 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385222 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385367 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385513 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385689 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.385859 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386054 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386155 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386363 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386497 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386707 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.386831 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.387108 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.387301 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.388912 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396155 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396293 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396462 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396462 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396700 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396841 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.396928 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397012 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397094 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397175 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397281 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397366 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397447 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397529 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397610 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397705 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397705 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397865 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.397949 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398090 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398090 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398252 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398252 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398450 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398537 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398672 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398843 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.398943 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.399104 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.399758 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.399848 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.399977 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400087 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400190 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400275 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400402 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400488 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400646 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400794 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.400960 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401109 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401313 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401475 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401579 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401715 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401844 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.401989 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402127 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402260 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402378 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402518 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402658 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402815 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.402959 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403091 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403219 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403379 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403521 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403669 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403815 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.403950 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404082 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404289 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404289 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404525 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404645 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404786 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.404949 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405128 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405259 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405391 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405501 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405633 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405794 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.405794 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406022 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406107 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406308 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406437 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406543 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406628 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.406865 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407260 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407403 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407529 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407658 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407797 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407930 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.407930 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408250 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408379 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408379 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408643 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408790 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.408790 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409038 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409258 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409417 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409565 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409673 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409823 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409823 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.409982 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410066 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410208 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410326 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410460 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410549 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410636 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410744 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.410921 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411019 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411121 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411240 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411336 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411427 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411520 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411612 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411612 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411870 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.411998 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412086 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412162 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412162 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412361 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412458 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412543 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412625 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412625 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412821 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.412909 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413062 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413279 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413279 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413615 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413739 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413739 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.413973 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414112 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414217 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414362 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414362 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414527 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414667 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.414667 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415069 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415199 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415199 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415419 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415516 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415516 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415779 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.415918 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416076 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416234 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416367 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416496 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416628 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416753 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.416753 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417257 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417453 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417599 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417703 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417703 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.417955 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418117 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418219 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418351 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418351 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418618 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418716 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.418925 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419075 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419075 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419388 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419523 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419523 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419782 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.419912 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420169 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420169 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420438 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420581 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420722 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420861 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.420990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421133 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421264 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421390 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421390 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421638 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421775 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.421916 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422056 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422194 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422344 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422490 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422636 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.422865 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423004 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423139 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423251 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423251 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423498 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423593 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423697 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423816 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.423995 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.424183 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.424311 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.424620 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.424721 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.424927 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.425101 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.425222 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.425529 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.425624 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.425832 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.426049 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.426152 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.426426 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.426591 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.426765 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427039 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427189 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427333 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427626 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427803 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.427943 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428085 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428230 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428374 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428533 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428684 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428836 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.428979 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.429206 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.429420 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.429585 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.429729 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.429877 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430023 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430170 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430339 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430502 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430649 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430835 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.430966 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.431197 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.431451 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.431610 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.431756 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.431898 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432207 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432347 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432497 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432628 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432813 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.432964 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.433112 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.433315 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.433503 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.433739 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.433974 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.434237 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.434361 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.434595 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.434833 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.434982 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.435230 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.435355 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.435536 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.435777 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.435915 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.436135 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.436256 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.436436 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.436568 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.436755 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.437053 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.437195 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.437379 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.437690 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.438007 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.438171 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.438330 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.438641 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.438815 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.439100 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.439277 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.439567 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.439732 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.439855 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.440089 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.440226 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.440504 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.440645 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.440811 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.441127 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.441267 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.441436 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.441598 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.441760 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.442044 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.442202 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.442352 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.442612 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.442805 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443025 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443228 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443373 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443574 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443769 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.443881 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.444181 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.444365 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.444558 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.444813 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.444927 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.445142 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.445247 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.445447 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.445690 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.445840 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.446691 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.446925 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.447367 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.447501 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.447708 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.447859 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448039 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448281 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448392 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448671 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448823 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.448987 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.449322 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.449480 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.449698 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.449927 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.450080 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.450260 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.450460 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.450696 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451038 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451224 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451224 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451508 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451605 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451836 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.451926 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.452137 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.452476 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.452811 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.452811 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.453118 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.453277 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.453438 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.453818 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.454101 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.454273 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.454273 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.454721 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.454986 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455083 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455184 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455277 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455361 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455578 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455880 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.455986 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.456185 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.456510 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.456601 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.456817 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.457079 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.457205 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.457510 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.457664 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.457818 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.458125 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.458425 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.458633 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.458752 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459040 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459236 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459458 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459663 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459864 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.459957 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.460244 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.460428 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.460549 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.460851 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.461000 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.461163 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.461514 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.461670 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.462335 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.462643 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.462757 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463085 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463188 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463391 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463649 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463739 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.463992 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464209 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464338 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464555 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464647 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464883 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.464974 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465230 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465340 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465541 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465692 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465842 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.465944 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466154 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466252 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466464 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466568 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466845 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.466939 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.467195 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.467502 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.467606 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.467847 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.468108 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.468200 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.468613 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.468792 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.469004 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.469200 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.469399 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.469735 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.469832 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470060 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470314 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470415 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470671 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470823 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.470997 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471171 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471317 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471492 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471624 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471837 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.471950 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.472232 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.472330 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.472653 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.472744 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.472994 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473094 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473300 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473400 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473607 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.473913 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474013 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474216 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474307 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474518 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474611 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474852 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.474947 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475158 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475258 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475501 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475618 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475768 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.475901 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.476078 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.476204 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.476412 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.476676 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.476924 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477034 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477118 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477412 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477518 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477643 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.477761 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.479656 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.480197 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.480447 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.480652 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.481067 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.481315 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.481536 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.481684 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.481780 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.482102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.482318 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.482461 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.482816 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.482987 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483077 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483160 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483260 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483352 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483436 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483518 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483601 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483692 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483778 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.483915 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484003 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484132 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484219 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484349 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484448 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484448 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484662 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484662 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484871 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.484975 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485066 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485149 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485149 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485337 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485480 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485568 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485568 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485774 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485911 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.485998 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486140 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486140 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486374 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486462 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486462 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486670 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486785 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.486917 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487003 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487139 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487227 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487227 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487442 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487572 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487688 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487841 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.487932 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.488152 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.488255 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489040 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489154 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489293 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489380 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489479 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489563 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489645 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489727 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489809 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.489987 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490149 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490245 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490335 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490418 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490501 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490710 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.490844 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.491196 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.491307 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.491468 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.491719 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.491848 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.492091 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.492251 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.492399 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.492708 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.492821 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.493048 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.493282 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.493399 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.493654 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.493859 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494004 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494274 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494426 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494576 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494716 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.494898 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.495160 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.495287 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.495613 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.495722 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.495939 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496045 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496228 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496348 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496544 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496644 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.496860 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497087 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497190 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497451 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497705 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497878 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.497967 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498198 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498381 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498497 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498698 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498841 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.498914 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502350 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502462 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502553 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502637 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502720 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502817 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502980 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.502980 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503107 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503184 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503260 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503401 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503497 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503588 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503658 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503739 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503826 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.503922 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504004 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504086 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504156 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504224 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504303 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504393 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504476 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504557 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504637 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504718 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.504908 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505123 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505255 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505343 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505425 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505504 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505587 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505587 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505736 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505819 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505899 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505977 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.505977 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506116 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506185 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506260 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506330 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506758 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506902 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.506990 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507079 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507157 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507227 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507453 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507573 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507781 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.507877 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.508093 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.508230 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.508417 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509117 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509245 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509393 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509557 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509742 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.509890 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.510159 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.510295 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.510534 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.510704 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.510888 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511001 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511330 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511431 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511644 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511828 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.511986 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512194 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512310 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512562 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512667 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512879 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.512969 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.513322 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.513485 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.513578 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:32:20.513829 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.514271 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.514656 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.515057 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.515378 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.515925 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.516458 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.516847 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.517176 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.517533 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.517916 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.518332 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520207 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520207 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520207 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520207 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520487 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.520897 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.521366 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.521801 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.522178 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.522522 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.522911 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.523297 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.523656 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.524031 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.525040 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.525331 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.525679 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.526016 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.526327 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.526640 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.526977 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:32:20.527222 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:32:20.676597 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO dbcounter [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Registered counter for database nova_api Aug 29 22:32:20.691296 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO dbcounter [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Registered counter for database nova_api Aug 29 22:32:20.701548 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_db.sqlalchemy.engines [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.712786 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_db.sqlalchemy.engines [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.713515 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writer thread running {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.723007 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writer thread running {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.781467 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.context [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfd9c997-d887-4047-b0a0-688098ec2707(cell1) {{(pid=133479) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:32:20.781745 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.context [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfd9c997-d887-4047-b0a0-688098ec2707(cell1) {{(pid=133480) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:32:20.785429 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:32:20.785620 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:32:20.785913 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:32:20.786098 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:32:20.787570 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:32:20.787706 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:32:20.788323 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:32:20.788478 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:32:20.788788 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:32:20.788929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:32:20.790991 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:32:20.791203 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_concurrency.lockutils [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:32:20.793229 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO dbcounter [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Registered counter for database nova_cell0 Aug 29 22:32:20.793378 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO dbcounter [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Registered counter for database nova_cell0 Aug 29 22:32:20.798267 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO dbcounter [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Registered counter for database nova_cell1 Aug 29 22:32:20.799044 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO dbcounter [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Registered counter for database nova_cell1 Aug 29 22:32:20.808049 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_db.sqlalchemy.engines [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.810595 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_db.sqlalchemy.engines [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.813353 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_db.sqlalchemy.engines [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.816969 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_db.sqlalchemy.engines [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.820253 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writer thread running {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.825187 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writer thread running {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.827058 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writer thread running {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.828709 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writer thread running {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.978967 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO dbcounter [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Registered counter for database nova_cell0 Aug 29 22:32:20.988334 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO dbcounter [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Registered counter for database nova_cell0 Aug 29 22:32:20.989194 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG oslo_db.sqlalchemy.engines [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:20.997262 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writer thread running {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:20.999121 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_db.sqlalchemy.engines [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:32:21.005654 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writer thread running {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:32:21.364662 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: WARNING keystonemiddleware.auth_token [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:32:21.373289 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: WARNING keystonemiddleware.auth_token [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:32:21.382018 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: WARNING keystonemiddleware.auth_token [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:32:21.390316 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: WARNING keystonemiddleware.auth_token [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:32:21.729060 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: WARNING keystonemiddleware.auth_token [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:32:21.735321 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: WARNING keystonemiddleware.auth_token [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:32:21.740655 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fc42889c0 pid: 133479 (default app) Aug 29 22:32:21.743430 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:32:21.744615 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002427 Aug 29 22:32:21.745027 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 788 bytes} [Mon Aug 29 22:32:21 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:32:21.747875 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: WARNING keystonemiddleware.auth_token [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:32:21.754226 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: WARNING keystonemiddleware.auth_token [None req-2c60d306-6f9e-4254-a1f5-ae1c96ff0160 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:32:21.759978 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fc42889c0 pid: 133480 (default app) Aug 29 22:33:47.087483 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:33:47.088445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 29 22:33:47.089321 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:33:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:33:47.107183 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_api:SELECT=3 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:47.108380 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_cell1:SELECT=3 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:47.109385 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_cell0:SELECT=3 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:47.110415 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:48.084252 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-3f4d0197-94a5-4d5e-a6d6-7f9689abf970 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:33:48.119835 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-3f4d0197-94a5-4d5e-a6d6-7f9689abf970 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.019433 Aug 29 22:33:48.121020 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1292 bytes} [Mon Aug 29 22:33:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:33:50.676854 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:33:50.678301 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-20ce05a0-a210-4c45-83b5-8e46c501ff09 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Aug 29 22:33:50.679083 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 3/4] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:33:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:33:51.243600 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-17042a16-75c3-46ef-a50f-5270de451856 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:51.293193 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-17042a16-75c3-46ef-a50f-5270de451856 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.606256 Aug 29 22:33:51.298845 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 2/5] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:33:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:51.310630 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_api:SELECT=3 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.311793 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_cell1:SELECT=3 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.312874 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_cell0:SELECT=3 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.314302 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:51.560589 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-d5571d66-0e7a-420a-8078-535524a92055 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:51.636036 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-d5571d66-0e7a-420a-8078-535524a92055 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333121 Aug 29 22:33:51.636724 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 4/6] 10.222.0.77 () {64 vars in 1336 bytes} [Mon Aug 29 22:33:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:33:54.098807 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-17042a16-75c3-46ef-a50f-5270de451856 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:33:54.100692 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-17042a16-75c3-46ef-a50f-5270de451856 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002400 Aug 29 22:33:54.101252 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 3/7] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:33:54.921581 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-f66fdb88-b6fc-4ece-a6cb-db21c94ae0ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "ram": 512, "rxtx_factor": 1.0}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:54.971514 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-f66fdb88-b6fc-4ece-a6cb-db21c94ae0ef admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.862864 Aug 29 22:33:54.974831 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 5/8] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:33:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:54.984479 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-bf89800c-21db-4828-862b-5111bdd6ec67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:55.022573 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-bf89800c-21db-4828-862b-5111bdd6ec67 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041808 Aug 29 22:33:55.023201 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 4/9] 10.222.0.77 () {64 vars in 1336 bytes} [Mon Aug 29 22:33:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:33:57.497624 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-f66fdb88-b6fc-4ece-a6cb-db21c94ae0ef admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:33:57.498643 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-f66fdb88-b6fc-4ece-a6cb-db21c94ae0ef admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 22:33:57.499292 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:33:57.932892 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-be97da51-7047-42a9-a2b9-622868108dcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "rxtx_factor": 1.0}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:57.951674 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-be97da51-7047-42a9-a2b9-622868108dcf admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445823 Aug 29 22:33:57.952228 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 5/11] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:33:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:57.966325 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-2380d663-1582-427a-9daa-b4f82d608c0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:33:57.992282 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-2380d663-1582-427a-9daa-b4f82d608c0e admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029907 Aug 29 22:33:57.992860 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 7/12] 10.222.0.77 () {64 vars in 1336 bytes} [Mon Aug 29 22:33:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:34:00.427050 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-be97da51-7047-42a9-a2b9-622868108dcf admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:00.428037 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-be97da51-7047-42a9-a2b9-622868108dcf admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 29 22:34:00.428439 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 6/13] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:00.976015 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-e109759d-e892-467b-91db-186c539fc702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "name": "ds2G"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:01.000388 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-e109759d-e892-467b-91db-186c539fc702 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565782 Aug 29 22:34:01.003117 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 8/14] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:01.014168 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-6ca4619b-00ca-4838-8e1d-8760b9949fc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:01.042843 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-6ca4619b-00ca-4838-8e1d-8760b9949fc4 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032359 Aug 29 22:34:01.046666 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 7/15] 10.222.0.77 () {64 vars in 1336 bytes} [Mon Aug 29 22:34:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:34:03.532779 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-e109759d-e892-467b-91db-186c539fc702 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:03.533928 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-e109759d-e892-467b-91db-186c539fc702 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 29 22:34:03.534495 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 9/16] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:04.064636 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "disk": 20, "name": "ds4G"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:04.085989 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.544780 Aug 29 22:34:04.087039 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 8/17] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:04.099080 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-d608877e-4b43-4b09-bf3d-4b2cafa88b82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:04.126440 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-d608877e-4b43-4b09-bf3d-4b2cafa88b82 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031023 Aug 29 22:34:04.127295 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 10/18] 10.222.0.77 () {64 vars in 1336 bytes} [Mon Aug 29 22:34:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:34:06.675339 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:06.676793 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 29 22:34:06.677360 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 9/19] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:07.244688 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-8d46a017-d9bc-4ba3-8500-2220d91ab375 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:07.271717 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-8d46a017-d9bc-4ba3-8500-2220d91ab375 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.587608 Aug 29 22:34:07.272457 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1292 bytes} [Mon Aug 29 22:34:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:34:09.931904 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:09.933515 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-ec244358-ffbb-49cc-99f3-0716ed194c94 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Aug 29 22:34:09.934154 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:34:10.518545 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-1a1ec1fe-41e0-461f-9237-ddaee8797340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:10.540516 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-1a1ec1fe-41e0-461f-9237-ddaee8797340 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.598081 Aug 29 22:34:10.541037 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 12/22] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:34:10.560891 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-59ba2d5c-1bd8-4332-890e-457d92b8d1ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:10.594668 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-59ba2d5c-1bd8-4332-890e-457d92b8d1ef admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037462 Aug 29 22:34:10.598759 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 11/23] 10.222.0.77 () {64 vars in 1333 bytes} [Mon Aug 29 22:34:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:34:13.124189 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-1a1ec1fe-41e0-461f-9237-ddaee8797340 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:13.125446 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-1a1ec1fe-41e0-461f-9237-ddaee8797340 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Aug 29 22:34:13.126201 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:13.507769 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-12510606-cff7-4212-a149-52484239d664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:13.527699 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-12510606-cff7-4212-a149-52484239d664 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.395001 Aug 29 22:34:13.528433 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 12/25] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:34:13.541472 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-497aa771-512e-44af-af3e-dddd29216989 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:13.564950 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-497aa771-512e-44af-af3e-dddd29216989 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027269 Aug 29 22:34:13.565511 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 14/26] 10.222.0.77 () {64 vars in 1333 bytes} [Mon Aug 29 22:34:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:34:16.015714 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-12510606-cff7-4212-a149-52484239d664 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:16.017214 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-12510606-cff7-4212-a149-52484239d664 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 29 22:34:16.017869 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:16.642060 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c31a3c4a-8c19-4b94-abdb-3126a2eabb8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:16.673225 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-c31a3c4a-8c19-4b94-abdb-3126a2eabb8b admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.648770 Aug 29 22:34:16.673998 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 15/28] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:34:16.695701 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-c0873c7e-a59f-4c3c-81ea-d85d949cacd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:16.740495 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-c0873c7e-a59f-4c3c-81ea-d85d949cacd9 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051202 Aug 29 22:34:16.741402 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 14/29] 10.222.0.77 () {64 vars in 1333 bytes} [Mon Aug 29 22:34:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:34:19.320609 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c31a3c4a-8c19-4b94-abdb-3126a2eabb8b admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:19.322034 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-c31a3c4a-8c19-4b94-abdb-3126a2eabb8b admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Aug 29 22:34:19.322542 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 16/30] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:19.851874 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a6d5b74e-c639-4252-a762-a255d163a85d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:19.861746 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:19.882068 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-a6d5b74e-c639-4252-a762-a255d163a85d admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.551292 Aug 29 22:34:19.882627 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 15/31] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:19.896539 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-436cf4f6-494a-444e-bc6c-6f1add83a8a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:19.922996 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-436cf4f6-494a-444e-bc6c-6f1add83a8a9 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031264 Aug 29 22:34:19.923744 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 17/32] 10.222.0.77 () {64 vars in 1333 bytes} [Mon Aug 29 22:34:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:34:22.487424 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a6d5b74e-c639-4252-a762-a255d163a85d admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:22.489218 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-a6d5b74e-c639-4252-a762-a255d163a85d admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Aug 29 22:34:22.490075 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:34:23.053950 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5"}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:23.061186 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:23.079631 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.583097 Aug 29 22:34:23.083807 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 18/34] 10.222.0.77 () {64 vars in 1283 bytes} [Mon Aug 29 22:34:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:23.093469 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-b44e8fa5-6c8d-40e6-9f48-360adff40827 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:23.127502 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-b44e8fa5-6c8d-40e6-9f48-360adff40827 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039075 Aug 29 22:34:23.128433 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 17/35] 10.222.0.77 () {64 vars in 1333 bytes} [Mon Aug 29 22:34:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:34:41.993928 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:41.995521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 22:34:41.995935 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:34:42.008275 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:42.448424 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-36a398fa-b9b1-475a-b288-f3d8113622b3 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:42.471108 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-36a398fa-b9b1-475a-b288-f3d8113622b3 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.467133 Aug 29 22:34:42.471674 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1292 bytes} [Mon Aug 29 22:34:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:43.586265 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:43.587300 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-47200158-df5d-423c-8091-f8dc1121823a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 22:34:43.587705 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:44.168454 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-fc95c03f-42f8-41c6-9274-c6278c62655a admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:44.174789 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.wsgi [None req-fc95c03f-42f8-41c6-9274-c6278c62655a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-fc95c03f-42f8-41c6-9274-c6278c62655a admin admin] Request method failure captured: Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept: application/json Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept-Encoding: gzip, deflate Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Connection: keep-alive Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Content-Length: 0 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Host: 10.222.0.77 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-System-Scope: None Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: User-Agent: python-novaclient Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Auth-Token: gAAAAABjDT8DJDasjDe1XFMTtyk9ax4WBQzSk_UelsBd5MqlGFDcIFjkoEB5lEtA2IX0CzEm-L3em58yl05CWFjMHzE-qdI2BuPijhJJJx1au8_WSB-INAgi3A3kjVAbUiyE56K6HiszjvwyRbATIrwdoL3TZ-zl2dMelJC9c8m1SnrqgxQ7mt0 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Id: None Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Name: None Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Identity-Status: Confirmed Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Is-Admin-Project: True Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Id: default Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Name: Default Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Name: admin Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Role: reader,member,admin Aug 29 22:34:44.178231 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Roles: reader,member,admin Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant: admin Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Name: admin Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User: admin Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Id: default Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Name: Default Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Name: admin Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: method: > Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: exception: Flavor 42 could not be found. Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: action_args: {'id': '42'} Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:44.180304 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:44.181204 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.183042 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-fc95c03f-42f8-41c6-9274-c6278c62655a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=133480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:44.184547 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-fc95c03f-42f8-41c6-9274-c6278c62655a admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.452493 Aug 29 22:34:44.184547 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 19/39] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Aug 29 22:34:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:44.190654 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-d47d6a45-302b-436e-b0da-3c8c69156ec8 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:44.218495 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-d47d6a45-302b-436e-b0da-3c8c69156ec8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031765 Aug 29 22:34:44.219100 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:44.229517 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-5468b467-fdab-4395-8ef0-971ae05dfdee admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:44.252826 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-5468b467-fdab-4395-8ef0-971ae05dfdee admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027145 Aug 29 22:34:44.253397 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:44.263905 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-b5d90445-58dd-4470-9a21-b6f9af9d4012 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:44.270198 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.wsgi [None req-b5d90445-58dd-4470-9a21-b6f9af9d4012 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-b5d90445-58dd-4470-9a21-b6f9af9d4012 admin admin] Request method failure captured: Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept: application/json Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept-Encoding: gzip, deflate Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Connection: keep-alive Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Content-Length: 0 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Host: 10.222.0.77 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-System-Scope: None Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: User-Agent: python-novaclient Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Auth-Token: gAAAAABjDT8DJDasjDe1XFMTtyk9ax4WBQzSk_UelsBd5MqlGFDcIFjkoEB5lEtA2IX0CzEm-L3em58yl05CWFjMHzE-qdI2BuPijhJJJx1au8_WSB-INAgi3A3kjVAbUiyE56K6HiszjvwyRbATIrwdoL3TZ-zl2dMelJC9c8m1SnrqgxQ7mt0 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Id: None Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Name: None Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Identity-Status: Confirmed Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Is-Admin-Project: True Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Id: default Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Name: Default Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Name: admin Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Role: reader,member,admin Aug 29 22:34:44.273521 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Roles: reader,member,admin Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant: admin Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Name: admin Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User: admin Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Id: default Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Name: Default Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Name: admin Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: method: > Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: exception: Flavor 42 could not be found. Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: action_args: {'id': '42'} Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:44.275028 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:44.276445 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:44.277772 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-b5d90445-58dd-4470-9a21-b6f9af9d4012 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=133479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:44.278876 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-b5d90445-58dd-4470-9a21-b6f9af9d4012 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015254 Aug 29 22:34:44.278876 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 22/42] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Aug 29 22:34:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:45.280954 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-5468b467-fdab-4395-8ef0-971ae05dfdee admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:45.281982 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-5468b467-fdab-4395-8ef0-971ae05dfdee admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003902 Aug 29 22:34:45.282387 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:45.846533 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-547d95f8-4771-49c2-816a-dc63970c3fef admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:45.852419 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.wsgi [None req-547d95f8-4771-49c2-816a-dc63970c3fef admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-547d95f8-4771-49c2-816a-dc63970c3fef admin admin] Request method failure captured: Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept: application/json Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept-Encoding: gzip, deflate Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Connection: keep-alive Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Content-Length: 0 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Host: 10.222.0.77 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-System-Scope: None Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: User-Agent: python-novaclient Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Auth-Token: gAAAAABjDT8FV7_7PYxE3Pw2coKGaz4DSQQAoHfhcp7-tXnbcm7fMZcvgV_V-wCWn7aPXFdjUMAlMFEluO30NVarKyZs1FIyaU4fJSilIARfpF_oxcy0-WjDHwyHsH720U9QuZyUQ3rFJ5KwMj64K1zK3H_UNZbW5Y35eBEKzsIyo7lRC9lyKPE Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Id: None Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Name: None Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Identity-Status: Confirmed Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Is-Admin-Project: True Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Id: default Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Name: Default Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Name: admin Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Role: reader,member,admin Aug 29 22:34:45.853929 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Roles: reader,member,admin Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant: admin Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Name: admin Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User: admin Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Id: default Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Name: Default Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Name: admin Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: method: > Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: exception: Flavor 84 could not be found. Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: action_args: {'id': '84'} Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:45.855698 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:45.856951 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.858376 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-547d95f8-4771-49c2-816a-dc63970c3fef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=133479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:45.859692 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-547d95f8-4771-49c2-816a-dc63970c3fef admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.434989 Aug 29 22:34:45.859692 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Aug 29 22:34:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:45.865559 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a3943779-ecaa-4477-b638-fd1ef8fa849c admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:45.880709 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-a3943779-ecaa-4477-b638-fd1ef8fa849c admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018605 Aug 29 22:34:45.881485 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:45.892183 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-da74c800-3951-43e7-96ba-a48399af8504 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:45.907903 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-da74c800-3951-43e7-96ba-a48399af8504 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019191 Aug 29 22:34:45.908482 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:45.918607 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a3c8d487-821b-4d4f-b2f0-79a5803ae974 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:45.924282 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.wsgi [None req-a3c8d487-821b-4d4f-b2f0-79a5803ae974 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a3c8d487-821b-4d4f-b2f0-79a5803ae974 admin admin] Request method failure captured: Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept: application/json Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept-Encoding: gzip, deflate Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Connection: keep-alive Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Content-Length: 0 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Host: 10.222.0.77 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-System-Scope: None Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: User-Agent: python-novaclient Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Auth-Token: gAAAAABjDT8FV7_7PYxE3Pw2coKGaz4DSQQAoHfhcp7-tXnbcm7fMZcvgV_V-wCWn7aPXFdjUMAlMFEluO30NVarKyZs1FIyaU4fJSilIARfpF_oxcy0-WjDHwyHsH720U9QuZyUQ3rFJ5KwMj64K1zK3H_UNZbW5Y35eBEKzsIyo7lRC9lyKPE Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Id: None Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Name: None Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Identity-Status: Confirmed Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Is-Admin-Project: True Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Id: default Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Name: Default Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Name: admin Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Role: reader,member,admin Aug 29 22:34:45.925798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Roles: reader,member,admin Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant: admin Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Name: admin Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User: admin Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Id: default Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Name: Default Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Name: admin Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: method: > Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: exception: Flavor 84 could not be found. Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: action_args: {'id': '84'} Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:45.927441 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:45.928506 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:45.929911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-a3c8d487-821b-4d4f-b2f0-79a5803ae974 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=133480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:45.931187 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-a3c8d487-821b-4d4f-b2f0-79a5803ae974 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012502 Aug 29 22:34:45.931187 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 23/47] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Aug 29 22:34:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:46.967712 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-da74c800-3951-43e7-96ba-a48399af8504 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:46.968640 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-da74c800-3951-43e7-96ba-a48399af8504 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Aug 29 22:34:46.969149 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 25/48] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:47.563402 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-3895a388-2a1b-4a9f-8859-c37947e97386 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:47.569315 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.wsgi [None req-3895a388-2a1b-4a9f-8859-c37947e97386 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-3895a388-2a1b-4a9f-8859-c37947e97386 admin admin] Request method failure captured: Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept: application/json Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Accept-Encoding: gzip, deflate Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Connection: keep-alive Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Content-Length: 0 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Host: 10.222.0.77 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Openstack-System-Scope: None Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: User-Agent: python-novaclient Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Auth-Token: gAAAAABjDT8GlecVpqjsxBMSyG8vEQyFZxDAJpj78KUZlWZF0cH8kSwVEphhsdf10W1qDIKNghKXPx6FIhWXhX71x0FTVPLupaQBzVbAwlLWSnwgYW4R9CcS1CWQPusRZZ5ybI0dNf992KWJcJJxBUCATKBM2ZMXkZCmmLqb44LmnfDhM9C2OlQ Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Id: None Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Domain-Name: None Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Identity-Status: Confirmed Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Is-Admin-Project: True Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Id: default Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Domain-Name: Default Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Project-Name: admin Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Role: reader,member,admin Aug 29 22:34:47.570861 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Roles: reader,member,admin Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant: admin Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-Tenant-Name: admin Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User: admin Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Id: default Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Domain-Name: Default Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: X-User-Name: admin Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: method: > Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: exception: Flavor 451 could not be found. Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: action_args: {'id': '451'} Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:47.573098 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:47.574102 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.576047 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-3895a388-2a1b-4a9f-8859-c37947e97386 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=133480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:47.577302 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-3895a388-2a1b-4a9f-8859-c37947e97386 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.464021 Aug 29 22:34:47.577302 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 24/49] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:34:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:47.582655 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c5312071-30c5-4eb4-8ae2-0320bc560167 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:47.599261 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-c5312071-30c5-4eb4-8ae2-0320bc560167 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019398 Aug 29 22:34:47.599261 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 26/50] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:47.610152 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:47.628365 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022548 Aug 29 22:34:47.628954 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Aug 29 22:34:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:34:47.639977 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c3ebfa77-e349-48dc-96eb-c563e88136e5 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:47.646339 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.wsgi [None req-c3ebfa77-e349-48dc-96eb-c563e88136e5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c3ebfa77-e349-48dc-96eb-c563e88136e5 admin admin] Request method failure captured: Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept: application/json Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Accept-Encoding: gzip, deflate Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Connection: keep-alive Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Content-Length: 0 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Host: 10.222.0.77 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-Api-Version: compute 2.90 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Openstack-System-Scope: None Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: User-Agent: python-novaclient Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Auth-Token: gAAAAABjDT8GlecVpqjsxBMSyG8vEQyFZxDAJpj78KUZlWZF0cH8kSwVEphhsdf10W1qDIKNghKXPx6FIhWXhX71x0FTVPLupaQBzVbAwlLWSnwgYW4R9CcS1CWQPusRZZ5ybI0dNf992KWJcJJxBUCATKBM2ZMXkZCmmLqb44LmnfDhM9C2OlQ Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Id: None Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Domain-Name: None Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Identity-Status: Confirmed Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Is-Admin-Project: True Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Id: default Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Domain-Name: Default Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Project-Name: admin Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Role: reader,member,admin Aug 29 22:34:47.648791 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Roles: reader,member,admin Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fabab14479bd4d4c870f8f76efa1b499", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fabab14479bd4d4c870f8f76efa1b499"}]}] Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant: admin Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Id: fabab14479bd4d4c870f8f76efa1b499 Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-Tenant-Name: admin Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User: admin Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Id: default Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Domain-Name: Default Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Id: 2f1e799f7d5b4182a2e0ecd338aaa415 Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: X-User-Name: admin Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: method: > Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: exception: Flavor 451 could not be found. Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: action_args: {'id': '451'} Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:34:47.651164 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:47.652454 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: ERROR nova.api.openstack.wsgi Aug 29 22:34:47.653570 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-c3ebfa77-e349-48dc-96eb-c563e88136e5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=133479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:34:47.654584 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-c3ebfa77-e349-48dc-96eb-c563e88136e5 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014751 Aug 29 22:34:47.654584 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:34:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:34:48.680556 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:48.682154 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 22:34:48.682563 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 26/53] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:49.282534 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-2f7cfad0-8fd2-4e0b-a860-478e07457aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:49.302606 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-2f7cfad0-8fd2-4e0b-a860-478e07457aac admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.474404 Aug 29 22:34:49.303187 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 28/54] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Aug 29 22:34:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:50.307444 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:50.308452 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 29 22:34:50.308859 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 27/55] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:50.913959 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-037fde73-c79e-4c9f-bd78-a8f8cd08ac95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:50.934426 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-037fde73-c79e-4c9f-bd78-a8f8cd08ac95 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.488400 Aug 29 22:34:50.935019 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 29/56] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Aug 29 22:34:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:34:51.962184 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:51.963821 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Aug 29 22:34:51.964222 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 28/57] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:34:52.569079 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-1a3bf735-efc4-4611-8223-56f0fb24476d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:52.596194 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-1a3bf735-efc4-4611-8223-56f0fb24476d admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.490403 Aug 29 22:34:52.596750 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 30/58] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Aug 29 22:34:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:53.597823 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:53.598858 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 22:34:53.599254 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 29/59] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:54.148913 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-3f50e292-3585-4656-8275-d93a2ab4ac7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:34:54.167810 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-3f50e292-3585-4656-8275-d93a2ab4ac7b admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.433838 Aug 29 22:34:54.168356 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 31/60] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Aug 29 22:34:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:55.156440 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:55.157436 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 29 22:34:55.157840 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 30/61] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:55.688746 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-846af6e5-939f-4d1c-b10f-863f8598800a admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:55.709297 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-846af6e5-939f-4d1c-b10f-863f8598800a admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.414439 Aug 29 22:34:55.709752 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 32/62] 10.222.0.77 () {60 vars in 1202 bytes} [Mon Aug 29 22:34:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:35:49.960472 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:49.961754 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-2dc4199a-ed20-4bcb-b4af-20ebfdaf4897 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 29 22:35:49.962080 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 31/63] 10.222.0.77 () {54 vars in 931 bytes} [Mon Aug 29 22:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:35:49.972944 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:50.364414 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-6a9251fa-f7d9-40c7-b6b1-bf1389bb3091 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:50.385450 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-6a9251fa-f7d9-40c7-b6b1-bf1389bb3091 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417393 Aug 29 22:35:50.385909 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 33/64] 10.222.0.77 () {60 vars in 1292 bytes} [Mon Aug 29 22:35:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:35:50.407134 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG dbcounter [-] [133480] Writing DB stats nova_api:SELECT=14 {{(pid=133480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:50.410857 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-f1ec0fbd-d49c-40ec-8d4a-fc1806f91209 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:50.418646 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-f1ec0fbd-d49c-40ec-8d4a-fc1806f91209 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012946 Aug 29 22:35:50.419223 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 32/65] 10.222.0.77 () {60 vars in 1283 bytes} [Mon Aug 29 22:35:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:35:50.430900 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-0ab5b542-8729-4cdc-9cf9-623231f812d1 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:50.438572 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-0ab5b542-8729-4cdc-9cf9-623231f812d1 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011252 Aug 29 22:35:50.439139 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 34/66] 10.222.0.77 () {60 vars in 1286 bytes} [Mon Aug 29 22:35:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:35:50.451342 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:50.459516 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011709 Aug 29 22:35:50.460054 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1286 bytes} [Mon Aug 29 22:35:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:35:50.471943 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-3b13ef4a-e8f6-418e-aade-d600087be87d admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:35:50.480019 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-3b13ef4a-e8f6-418e-aade-d600087be87d admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011664 Aug 29 22:35:50.480547 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 35/68] 10.222.0.77 () {60 vars in 1283 bytes} [Mon Aug 29 22:35:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:49.146722 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:49.147753 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 29 22:38:49.148155 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 34/69] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:38:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:38:49.289753 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_api:SELECT=6 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:49.455897 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:49.459494 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:38:49.459995 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:38:49.460422 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:38:49.461125 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:38:49.461593 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:38:49.462009 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:38:49.498752 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-d22605e4-400e-41d8-958b-10a914f61e3e admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210423 Aug 29 22:38:49.499322 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 36/70] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:38:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:38:50.347911 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:50.348915 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 29 22:38:50.349311 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 35/71] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:38:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:38:50.543682 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:50.547392 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:38:50.548408 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:38:50.548835 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:38:50.549536 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:38:50.549971 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:38:50.550485 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:38:50.570096 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-147dd237-9959-402b-b51b-3b87a0623bb2 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078764 Aug 29 22:38:50.570650 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 37/72] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:38:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:39:01.817187 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:39:01.818184 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 29 22:39:01.818571 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 36/73] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:39:01.963743 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_cell0:SELECT=4 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.964461 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_cell1:SELECT=4 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:01.965138 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG dbcounter [-] [133479] Writing DB stats nova_api:SELECT=8 {{(pid=133479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.012783 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:39:02.016868 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:02.017375 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:02.017807 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:02.018526 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:02.019000 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:02.019423 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:02.043784 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-14b9dbf3-f759-4b69-9f2c-3c8ab7392fb0 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084338 Aug 29 22:39:02.044258 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 38/74] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:39:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:39:02.862798 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: DEBUG nova.api.openstack.wsgi [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] Calling method '>' {{(pid=133480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:39:02.863843 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: INFO nova.api.openstack.requestlog [None req-9a32ae6a-b2e5-4454-a2c8-2a74d73f50e4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 29 22:39:02.864243 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: [pid: 133480|app: 0|req: 37/75] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Aug 29 22:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:39:03.055960 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG nova.api.openstack.wsgi [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Calling method '>' {{(pid=133479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:39:03.059510 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:03.059832 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:03.060290 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:03.061041 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:03.061488 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:03.061907 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: DEBUG oslo_concurrency.lockutils [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:03.084954 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: INFO nova.api.openstack.requestlog [None req-f5c3b4fe-d1d0-45b5-b61a-bf316a2836a7 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081142 Aug 29 22:39:03.085444 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: [pid: 133479|app: 0|req: 39/76] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Aug 29 22:39:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:39:59.984602 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: Mon Aug 29 22:39:59 2022 - graceful shutdown triggered... Aug 29 22:39:59.984678 dv-cinder-854270-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 22:39:59.985999 dv-cinder-854270-4-iscsi devstack@n-api.service[133480]: Gracefully killing worker 2 (pid: 133480)... Aug 29 22:39:59.986520 dv-cinder-854270-4-iscsi devstack@n-api.service[133479]: Gracefully killing worker 1 (pid: 133479)... Aug 29 22:40:00.987107 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: worker 1 buried after 1 seconds Aug 29 22:40:00.987107 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: worker 2 buried after 1 seconds Aug 29 22:40:00.987107 dv-cinder-854270-4-iscsi devstack@n-api.service[133478]: goodbye to uWSGI. Aug 29 22:40:00.988741 dv-cinder-854270-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 22:40:00.989301 dv-cinder-854270-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 22:40:00.992342 dv-cinder-854270-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:40:01.003593 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:40:01 2022] *** Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: nodename: dv-cinder-854270-4-iscsi Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: machine: x86_64 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: clock source: unix Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: pcre jit disabled Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: detected number of CPU cores: 4 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: current working directory: / Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: your processes number limit is 47680 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: your memory page size is 4096 bytes Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: detected max file descriptor number: 2048 Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: lock engine: pthread robust mutexes Aug 29 22:40:01.006149 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: thunder lock: enabled Aug 29 22:40:01.007222 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:40:01.007222 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:40:01.046864 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: Python main interpreter initialized at 0x55d840cac9c0 Aug 29 22:40:01.047138 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: python threads support enabled Aug 29 22:40:01.047257 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: your server socket listen backlog is limited to 100 connections Aug 29 22:40:01.047379 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:40:01.048128 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:40:01.048365 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: *** Operational MODE: preforking *** Aug 29 22:40:01.048805 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:40:01.048947 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: spawned uWSGI master process (pid: 148441) Aug 29 22:40:01.049398 dv-cinder-854270-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:40:01.052719 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: spawned uWSGI worker 1 (pid: 148456, cores: 1) Aug 29 22:40:01.052719 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: spawned uWSGI worker 2 (pid: 148457, cores: 1) Aug 29 22:40:01.052719 dv-cinder-854270-4-iscsi devstack@n-api.service[148441]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:40:01.729603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:40:01.746577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:40:02.943219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:40:02.943219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: from cryptography.utils import int_from_bytes Aug 29 22:40:02.943854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:40:02.943854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: from cryptography.utils import int_from_bytes Aug 29 22:40:02.944875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:40:02.944875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: from cryptography.utils import int_from_bytes Aug 29 22:40:02.945316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:40:02.945316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: from cryptography.utils import int_from_bytes Aug 29 22:40:05.558334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:40:05.559376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:40:05.559376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:40:05.559554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:40:05.559868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:40:05.560201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.560532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.560859 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.561184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.561686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.562010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.562346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.562700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.563166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.563522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.563975 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.564520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-4-iscsi {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.565106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.565661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.566206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.566768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.567322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.567769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.568095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.568619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.570011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.570011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.570011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.570383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.570819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.571115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.571391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.571943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.572478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.572820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.573498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-4-iscsi {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.574056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.574605 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.575036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:40:05.575555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.575638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:40:05.575845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:40:05.575965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.576209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:40:05.576335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.576519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:40:05.576861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.576981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.577251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.577380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.577604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.577895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.577996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.578297 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.578494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.578656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.578869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.579035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.579267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.579430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.580157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.580390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.580634 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.580801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.580953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-4-iscsi {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.581992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.582219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.582385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.582605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.582810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.582972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.583360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.583547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.583706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.583852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.584068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.584222 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.584374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.584556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.584713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585795 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.585960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.586297 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.586458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.586611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.586794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.586971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-4-iscsi {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587746 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.587899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.588169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.588343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.588587 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.588750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.588906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.589115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.589277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.589514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.589679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.589835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.590050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.590244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.590482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.590835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.591166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.591493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.591778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.591906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.592091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.592254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.592471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.592725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.592827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593342 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.593898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.594214 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.594316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.594542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.594709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.594895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596690 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.596847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.597083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.597224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.597460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.597568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.597772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.598078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.598197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.598405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.598583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.598688 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.599014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.599110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.599330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.599753 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.599864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.600755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.600874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.600965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601059 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.601979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.602079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.602326 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.602607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.602723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.602977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.603089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.603305 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.603476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.603748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.603941 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604253 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.604991 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.605234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.605364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.605539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.605794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.605889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.606177 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.606495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.606605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.606818 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.606932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607389 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.607990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.608216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.608320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.608606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.608724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.608917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.609160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.609262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.609526 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.609627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.609835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.610094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.610194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.610444 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.610580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.610809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.611114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.611199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.611451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.611700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.611819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612371 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612571 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.612998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.613109 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.613310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.613514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.613616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.613939 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.614055 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.614249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.614490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.614586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.614947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.615198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.615542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.615931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.616994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.617103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.617322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.617437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.617632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.617911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.618978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.619193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.619410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.619522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.619813 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.619903 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.620138 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.620364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.620462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.620751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.620835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.621059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.621295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.621389 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.621717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.621807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.622057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.622220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.622407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.622713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.622887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.623081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.623220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.623416 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.623696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.623787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.624047 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.624174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.624361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.624640 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.624725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.624997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.625133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.625313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.625629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.625737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.625992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.626114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.626265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.626636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.626940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.627041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.627157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.627328 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.627764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.627931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:40:05.628087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.628251 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.628419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.628602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.628855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.629897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.630144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.630310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.630471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.630845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.631180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.631342 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.631495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.631705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.631864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632350 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.632852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633634 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.633955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.634303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.634476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.634641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.634850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.635961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.636297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.636453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.637551 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.637725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.637891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.637891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.638552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.638717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.638717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.639935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.640979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.641326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.641480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.641644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.641856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.641856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.642701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.642914 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643806 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.643806 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.644081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.644252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.644596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.644746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.644746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645190 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.645926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.646582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.646885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.647147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.647656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.647656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648294 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.648907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.649967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650130 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650775 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.650973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.651962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652129 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.652902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.653792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.654123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.654278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.654626 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.654815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.654815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.655762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.655931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.655931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.656245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.656529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.657026 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.657203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.657203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.657512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.658976 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.659382 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.659631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.659806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.660846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.661797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.662240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.662405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.662565 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.662726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.662726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663232 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.663986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.664155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.664317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.664478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.664478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.664998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.665935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666260 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666260 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.666978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.667284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.667451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.667615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.667766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.667766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.668062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.668224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.668383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.668544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.669347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.669629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.669788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.669956 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670689 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.670981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671130 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671741 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.671834 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.672150 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.672259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.672469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.672790 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.672899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.673113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.673444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.673541 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.673770 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.673970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.674115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.674394 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.674511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.674891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.675018 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.675444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.675554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.675936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.676039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.676421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.676630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.676904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.678471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.678596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.678674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.678774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.678870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.679923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.680171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.680393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.680521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.680748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.680876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.681144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.681311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.681482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.681758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.681913 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.682075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.682363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.682470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.682709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.683056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.683160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.683373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.683672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.683775 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.684013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.684299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.684414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.684642 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.684916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.685009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.685269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.685481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.685576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.685893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.686014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.686225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.686532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.686627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.686876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.687091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.687195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.687495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.687602 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.687815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.688142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.688243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.688642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.688735 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.689167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.689296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.689420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.689661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.689811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.690066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.690182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.690421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.690642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.690783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.691126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.691221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.691448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.691658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.691761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.692999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.693341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.693495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.693644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.693794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.693967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.694214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.694362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.694575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.694859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.695242 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.695482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.695773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.695867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.696142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.696361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.696478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.696784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.696962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.697116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.697302 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.697433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.697746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.697830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.698058 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.698262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.698354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700664 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.700837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701763 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.701898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.702215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.702369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.702530 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.702783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.703791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.703791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.703970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704357 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.704970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.705264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.705384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.705576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.705783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.705936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.706251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.706405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.706685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.706856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.707190 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.707289 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.707594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.707744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.707916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.708195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.708307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.708534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.708692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.708847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.709174 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.709267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.709488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.709655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.709803 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.710137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.711407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.711517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.711719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.711848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.711848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712142 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.712886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.713981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.714127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.714312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.714590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.714758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.714996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.715154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.715312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.715653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.715931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.715931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.716156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.716311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.716563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.716905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.717022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.717194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.717329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.717510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.717768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.718000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.718097 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.718400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.718503 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.718832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.719098 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.719347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.719440 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.719689 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.719784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.720001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.721161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.721304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.721545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.721693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.721852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.722142 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.722302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.722657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.722834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.722928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.723230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.723352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.723545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.723864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.723960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.724187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.724370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.724506 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.724818 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.724921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.725130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.725368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.725487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.725861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.725964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.726184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.726418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.726519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.726859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.727032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.727194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.727523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.727670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.727834 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.728157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.728338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.728473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.728726 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.728852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.729080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.729379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.729488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.729705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.729860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.730022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.730372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.730478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.730655 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.730997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.731082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.731321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.731571 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.731687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.731938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.732132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.732271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.732621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.732731 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.732903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.733220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.733490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.733601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.733836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.733988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.734148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.734470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.734593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.734935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.735032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.735257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.735453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.735554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.735906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.736057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.736225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.736494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.736597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.736856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.737032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.737170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.737460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.737603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.737921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.738022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.738238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.738393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.738554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.738890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.739000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.739203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.739501 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.739612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.739839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.740053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.740214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.740529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.740646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.740840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.741141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.741278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.741465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.741689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.741805 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.742203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.742306 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.742521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.742794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.742911 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.743267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.743367 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.743586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.743871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.743973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.744219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.744422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.744549 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.744879 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.744980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.745193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.745511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.745607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.745824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.746062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.746156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.746474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.746601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.746867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.747136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.747241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.747457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.747765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.747861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.748103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.748300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.748424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.748756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.748859 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.749180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.749354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.749520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.749815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.749949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.750146 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.750480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.750573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.750821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.751115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.751262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.751470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.751729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.751850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.752083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.752333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.752442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.752711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.752877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.753030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.753345 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.753446 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.753660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.753971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.754066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.754281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.754509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.754611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.754937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.755084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.755270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.755615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.755794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.755978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.756166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.756305 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.756620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.756714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.756955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.757234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.757331 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.757577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.757783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.757885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.758188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.758405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.758537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.758878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.758987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.759205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.759428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.759577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.759868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.759966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.760187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.760481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.760598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.760849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.761025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.761180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.761508 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.761691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.761844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.762112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.762220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.762462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.762649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.762800 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.763119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.763228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.763433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.763748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.763848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.764993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.765324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.765428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.765637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.765881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.765984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.766269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.766438 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.766581 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.766917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.767533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.767756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.768066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.768175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.768400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.768605 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.768734 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.769050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.769151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.769379 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.769680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.769823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770355 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770634 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.770963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.771286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.771406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.771612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.771929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.772988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.773454 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.773564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.773796 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.774045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.774159 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.774432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.774591 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.774845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.775119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.775249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.775394 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.775714 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.775809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776033 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.776993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.777323 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.777419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.777661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.777856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.778006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.778333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.778441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.778656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.778972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.779352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.779352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.779538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.779666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.779986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.780093 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.780300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.780548 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.780663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.780930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.781087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.781252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.781573 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.781668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.781893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.782173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.782271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.782520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.783406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.783563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.783724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.783954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.784079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.784358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.784487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.784691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785348 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.785982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.786156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.786304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.786805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.786931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.787269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.787416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.787536 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.787860 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.787981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.788194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.788431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.788553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.788828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.788979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.789163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.789481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.789622 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.789797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.790054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.790175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.790419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.790590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.790782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.791085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.791180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.791404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.791719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.791814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.792049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.792264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.792361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.792799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.792982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.793329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.793498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.793649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.793898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.794001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.794304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.794440 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.794629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.794969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.795080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.795302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.795584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.795690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.795916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.796151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.796246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.796544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.796715 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.796856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.797168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.797269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.797489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.797774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.797890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.798104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.798897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799020 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.799929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.800053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.800241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.800363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.800826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.800922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801240 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.801870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.802082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.802203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.802396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.802831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.802831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.803917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.804237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.804460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.804779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.805039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.805415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.805754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.805863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806389 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.806847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.807805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808033 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.808804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809710 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.809934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810617 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.810960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.811922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812240 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812858 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.812964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.813996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.814163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.814307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.814459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.814648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.815322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.815568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.815706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.815831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.815954 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.816965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.817951 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.818133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.818263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.818452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.818705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.818873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819134 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819248 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.819845 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.820802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822275 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.822943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823540 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823712 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.823904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.824934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.825924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826423 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.826920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.827795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.828983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.829947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830355 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.830897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831527 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.831934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.832876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833183 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.833805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834021 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.834831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835001 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.835937 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836351 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836563 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.836970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.837928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.838957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839530 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.839845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.840812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.841975 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.842124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.842394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.842506 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.842598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.842938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.843050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.843256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.843491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.843616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.843873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.844051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.844186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.844493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.844603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.845254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.845375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.845470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.845746 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.846113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.846328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.846463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.846646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.846988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847622 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.847936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.848984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.849971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.850972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.851975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.852135 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=148456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:40:05.852232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.852522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.852844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.853158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.853475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.853789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.854101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.854419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.854754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.855071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.855385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.855703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.856021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.856348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.856685 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.857008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.857329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.857647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.857965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.858506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.858845 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.859183 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.859514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.859843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.860171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.860477 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.861379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.862337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.862337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.862337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.862835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.862973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.863300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.863617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.863925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.864249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.864561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.865190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.865545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.865862 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.866193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.866573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.866876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.867186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.867519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.867829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.868136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.868455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.868771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.869081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.869390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.869703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.870015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.870323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.870638 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.871024 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.871465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.871608 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.872058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.872433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.872657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.872826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.873121 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.873431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.873741 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.874056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.874365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.874678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.875015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.875396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.875719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.875945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.876333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.877220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.877530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.877841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.878166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.878481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.878832 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.879151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.879466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.879820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.880147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.880723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.881063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.881392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.881732 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.882067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.882378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.882690 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.883039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.883364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.883867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.884260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.884379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.884598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.884912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.885226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.885539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.885854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.886169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.886481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.886819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.887136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.887449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.887761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.888080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.888425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.888747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.889071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.889391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.889706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.890054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.890536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.890877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.891203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.891525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.891858 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.892201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.892512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.892946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.893260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.893578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.893902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.894232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.894543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.894906 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.895222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.895546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.895861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.896192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.896537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.896869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.897196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.897505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.897812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.898122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.898433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.898773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.899089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.899396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.899702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.900012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.900324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.900636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.900950 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.901258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.901570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.901877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.902183 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.902490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.902826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.903135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.903443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.903752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.904107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.904416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.904722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.905032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.905340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.905676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.906015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.906330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.906654 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.906996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.907324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.907659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.907985 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.908310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.908633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.908941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.909279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.909593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.909908 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.910222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.910537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.910876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.911190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.911522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.911851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.912161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.912488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.912812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.913163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.913455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.913770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.914104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.914421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.915273 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.915401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO dbcounter [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Registered counter for database nova_api Aug 29 22:40:05.915498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.915498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.915666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.915978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.916292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.916606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.916926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.917245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.917575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.917905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.918217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.918546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.918898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.919252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.919568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.919911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.920243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.920564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.920878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.921185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:40:05.921427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=148457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:40:05.936289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_db.sqlalchemy.engines [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:05.943482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writer thread running {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:05.986881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO dbcounter [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Registered counter for database nova_api Aug 29 22:40:06.000983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.context [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfd9c997-d887-4047-b0a0-688098ec2707(cell1) {{(pid=148456) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:40:06.005094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:06.005580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:06.007303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:06.008062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:06.008529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:06.008787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_db.sqlalchemy.engines [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.010568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:06.012621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO dbcounter [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Registered counter for database nova_cell0 Aug 29 22:40:06.016436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writer thread running {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.016750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO dbcounter [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Registered counter for database nova_cell1 Aug 29 22:40:06.024531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_db.sqlalchemy.engines [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.026582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_db.sqlalchemy.engines [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.033413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writer thread running {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.038194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writer thread running {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.078653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.context [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfd9c997-d887-4047-b0a0-688098ec2707(cell1) {{(pid=148457) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:40:06.082705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:06.083298 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:06.085159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:06.085784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:06.086250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:06.088323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:06.090870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO dbcounter [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Registered counter for database nova_cell0 Aug 29 22:40:06.094603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO dbcounter [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Registered counter for database nova_cell1 Aug 29 22:40:06.103370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_db.sqlalchemy.engines [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.105648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_db.sqlalchemy.engines [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.112380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writer thread running {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.114064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writer thread running {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.196081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO dbcounter [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Registered counter for database nova_cell0 Aug 29 22:40:06.205786 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_db.sqlalchemy.engines [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.213578 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writer thread running {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.268393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO dbcounter [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Registered counter for database nova_cell0 Aug 29 22:40:06.275994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_db.sqlalchemy.engines [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=148457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:40:06.281457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writer thread running {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:40:06.550230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: WARNING keystonemiddleware.auth_token [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:40:06.557631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: WARNING keystonemiddleware.auth_token [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:40:06.609716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: WARNING keystonemiddleware.auth_token [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:40:06.618169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: WARNING keystonemiddleware.auth_token [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:40:06.902620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: WARNING keystonemiddleware.auth_token [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:40:06.908678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: WARNING keystonemiddleware.auth_token [None req-30402a64-b912-466d-8d0d-6faca411fd1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:40:06.914014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d840cac9c0 pid: 148456 (default app) Aug 29 22:40:06.964161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: WARNING keystonemiddleware.auth_token [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:40:06.970193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: WARNING keystonemiddleware.auth_token [None req-41bb6fd9-e531-49fb-84be-072f5b8f4c6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:40:06.975826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d840cac9c0 pid: 148457 (default app) Aug 29 22:40:42.642974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:42.643635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:42.644595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:42.645579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:43.603464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f308bd77-2ea8-4f3e-b1ce-fa2b158d9325 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Action: 'create', calling method: .version_select at 0x7f5cf7cd6e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-874433727"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:40:46.340523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f308bd77-2ea8-4f3e-b1ce-fa2b158d9325 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.709255 Aug 29 22:40:46.341653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Aug 29 22:40:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3713 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 22:40:46.360543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:46.362686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:46.364684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:46.368237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:46.669743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-aa0757af-41a1-4edb-ba40-41a6798ede7e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7ccfa60>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:47.201565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fd7e07f7-2a40-4b6d-bd52-3afd9ea5509f tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b5aca0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:47.341544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fd7e07f7-2a40-4b6d-bd52-3afd9ea5509f tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/5d02d98d-32ed-4543-bc72-aeef3ebf3368" status: 200 len: 351 microversion: 2.1 time: 0.144228 Aug 29 22:40:47.352293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 2/2] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:47 2022] GET /compute/v2.1/os-volumes/5d02d98d-32ed-4543-bc72-aeef3ebf3368 => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:47.601647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-aa0757af-41a1-4edb-ba40-41a6798ede7e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 200 len: 345 microversion: 2.1 time: 1.248145 Aug 29 22:40:47.602814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:46 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 345 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:47.621578 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fe0989f9-85a7-4e9b-b598-1bd91d0ee1a9 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Action: 'create', calling method: .version_select at 0x7f5cf7b6f3a0>, body: {"snapshot": {"volume_id": "ab650e71-23c7-4a4e-af4c-0b361c5bb2d1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1373224047"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:40:48.076958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fe0989f9-85a7-4e9b-b598-1bd91d0ee1a9 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.463872 Aug 29 22:40:48.078803 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 3/4] 10.222.0.77 () {60 vars in 1162 bytes} [Mon Aug 29 22:40:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:40:48.093457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2831f3c0-0cd9-4010-9f0a-bcbac09a64fc tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b96ca0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:48.136639 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2831f3c0-0cd9-4010-9f0a-bcbac09a64fc tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 287 microversion: 2.1 time: 0.050367 Aug 29 22:40:48.137488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 2/5] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:48 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:48.149832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50170e5d-ad5a-4c30-8b7f-27e847cc2399 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b6e430>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:48.234124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-50170e5d-ad5a-4c30-8b7f-27e847cc2399 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.088979 Aug 29 22:40:48.234958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 4/6] 10.222.0.77 () {58 vars in 1140 bytes} [Mon Aug 29 22:40:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:48.247101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3dee5434-7970-451e-a127-84d8294cec31 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b54430>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:48.300641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3dee5434-7970-451e-a127-84d8294cec31 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 287 microversion: 2.1 time: 0.057650 Aug 29 22:40:48.301212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:48 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:49.032731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6a996d40-9521-4820-9509-1c57604d414a tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b6f310>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:49.176985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6a996d40-9521-4820-9509-1c57604d414a tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/d09d1ce6-f851-4464-9c03-edf8e7af1416" status: 200 len: 350 microversion: 2.1 time: 0.148585 Aug 29 22:40:49.177565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:49 2022] GET /compute/v2.1/os-volumes/d09d1ce6-f851-4464-9c03-edf8e7af1416 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:49.314379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2e3393a7-540d-4a59-9cd7-a5f4ab8d4340 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b54af0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:49.406375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2e3393a7-540d-4a59-9cd7-a5f4ab8d4340 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 287 microversion: 2.1 time: 0.096041 Aug 29 22:40:49.407252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 4/9] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:49 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:50.422447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c095ee5d-a51f-4e7e-977f-0b16b4102023 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b5aa60>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:50.480457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c095ee5d-a51f-4e7e-977f-0b16b4102023 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 287 microversion: 2.1 time: 0.064467 Aug 29 22:40:50.485475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 6/10] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:50 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:51.498923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-399a9079-b980-497f-ae77-c9312d3a556d tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b96d30>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:51.678134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-399a9079-b980-497f-ae77-c9312d3a556d tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 288 microversion: 2.1 time: 0.183666 Aug 29 22:40:51.679520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 5/11] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:51 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:40:51.692734 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c4e8a052-705f-4a7b-8c9b-eb4f74869694 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b6e0d0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:51.800613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c4e8a052-705f-4a7b-8c9b-eb4f74869694 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 202 len: 0 microversion: 2.1 time: 0.113361 Aug 29 22:40:51.801539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1254 bytes} [Mon Aug 29 22:40:51 2022] DELETE /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:40:51.818983 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c916fcdf-1662-4560-b8be-22528a6d2bb4 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b54a60>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:51.905408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c916fcdf-1662-4560-b8be-22528a6d2bb4 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 200 len: 287 microversion: 2.1 time: 0.097566 Aug 29 22:40:51.919365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:51 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:52.277527 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-27560d0c-3c3f-4461-8085-24ff49100141 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b5ac10>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:52.440986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-27560d0c-3c3f-4461-8085-24ff49100141 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/6e8a3b27-7795-4c10-9764-590d705b9981" status: 200 len: 351 microversion: 2.1 time: 0.167642 Aug 29 22:40:52.450781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 8/14] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:52 2022] GET /compute/v2.1/os-volumes/6e8a3b27-7795-4c10-9764-590d705b9981 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:52.463935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e7b24ebc-89a6-47f6-a7f4-a5e7121520f6 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b54430>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:52.717670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e7b24ebc-89a6-47f6-a7f4-a5e7121520f6 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.264013 Aug 29 22:40:52.728469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 7/15] 10.222.0.77 () {58 vars in 1134 bytes} [Mon Aug 29 22:40:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:40:52.735661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bb52c53a-557c-4d3c-9c76-10e2c924baa2 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b6f3a0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:52.926268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-900ee024-2dc6-4990-92ca-c5c10b5ea804 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b96dc0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.021685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bb52c53a-557c-4d3c-9c76-10e2c924baa2 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.289774 Aug 29 22:40:53.022835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 9/16] 10.222.0.77 () {58 vars in 1149 bytes} [Mon Aug 29 22:40:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:53.036637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-75165cd3-bb2f-4bcf-bbc4-fb9298ee28f2 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b00040>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.079514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-900ee024-2dc6-4990-92ca-c5c10b5ea804 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] HTTP exception thrown: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-900ee024-2dc6-4990-92ca-c5c10b5ea804 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Request method failure captured: Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 HTTP/1.1 Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUBqH9TM884jU3UeyMr_aUGnce_e7UHihFOrDj7AoSCx6MM3BLWRzRNQZe9cG_1JoLhsb02pdZdAbWrFDewcdI1guB366ucS2PlTLaQejG6DF925TY9X7WJmwP3cuJwz3JPiGq9QMSBey1fGp2sdBKez71y6c-hP50TrfH8S3bzCick Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:40:53.084170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ff9bc95c0e074f66a511f524154b70bf", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}] Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 298bfaf3cc0d478093d3ee97a3c1e734 Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174'} Aug 29 22:40:53.085609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. (HTTP 404) (Request-ID: req-95719365-8605-4e08-82bb-8a313268af55) Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.086332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:53.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 22:40:53.088552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-900ee024-2dc6-4990-92ca-c5c10b5ea804 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Returning 404 to user: Snapshot ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-900ee024-2dc6-4990-92ca-c5c10b5ea804 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174" status: 404 len: 111 microversion: 2.1 time: 0.170062 Aug 29 22:40:53.093362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 8/17] 10.222.0.77 () {58 vars in 1251 bytes} [Mon Aug 29 22:40:52 2022] GET /compute/v2.1/os-snapshots/ea82e4d0-9d42-4c5c-b9bb-4bc06cc07174 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:40:53.138100 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-12205297-1e00-4d38-96e8-e40ffddc4286 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b5e430>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.316295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-75165cd3-bb2f-4bcf-bbc4-fb9298ee28f2 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.283450 Aug 29 22:40:53.316888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 10/18] 10.222.0.77 () {58 vars in 1134 bytes} [Mon Aug 29 22:40:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:40:53.332787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-399d2891-3157-467c-af68-a96b79498789 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b6e310>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.454401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-12205297-1e00-4d38-96e8-e40ffddc4286 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 202 len: 0 microversion: 2.1 time: 0.355891 Aug 29 22:40:53.455232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 9/19] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:40:53 2022] DELETE /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:40:53.464786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-58174be5-d19f-409b-951b-b7b0fb97c8d1 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b5ec10>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.562967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-58174be5-d19f-409b-951b-b7b0fb97c8d1 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 200 len: 344 microversion: 2.1 time: 0.103244 Aug 29 22:40:53.563527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 10/20] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:53 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:40:53.593468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-399d2891-3157-467c-af68-a96b79498789 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.266543 Aug 29 22:40:53.594503 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 11/21] 10.222.0.77 () {58 vars in 1167 bytes} [Mon Aug 29 22:40:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:53.614777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-61b17e29-7711-4ef3-aeaa-298bbffa72da tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b5edc0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:53.828944 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-61b17e29-7711-4ef3-aeaa-298bbffa72da tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217846 Aug 29 22:40:53.830136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 11/22] 10.222.0.77 () {58 vars in 1170 bytes} [Mon Aug 29 22:40:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:53.846496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ca65897a-f725-4ffe-a285-dfd85d9aacd6 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7cd6790>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:54.033731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ca65897a-f725-4ffe-a285-dfd85d9aacd6 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.191490 Aug 29 22:40:54.034298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 12/23] 10.222.0.77 () {58 vars in 1155 bytes} [Mon Aug 29 22:40:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:40:54.048098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1db468f6-b7ff-4c70-8035-13a4b0f2de24 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7ad1700>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:54.292421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1db468f6-b7ff-4c70-8035-13a4b0f2de24 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.247988 Aug 29 22:40:54.293414 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 12/24] 10.222.0.77 () {58 vars in 1188 bytes} [Mon Aug 29 22:40:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:54.314516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c4892327-6f17-4fa9-8771-2c275953c9b9 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] Calling method '.version_select at 0x7f5cf7b00430>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:54.580120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3b5600ab-3cec-4447-b40c-1ebb2251ce2e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7ad1b80>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:54.591527 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c4892327-6f17-4fa9-8771-2c275953c9b9 tempest-VolumesTestJSON-491824683 tempest-VolumesTestJSON-491824683-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.285371 Aug 29 22:40:54.602927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 13/25] 10.222.0.77 () {58 vars in 1155 bytes} [Mon Aug 29 22:40:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:40:54.723936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3b5600ab-3cec-4447-b40c-1ebb2251ce2e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 200 len: 344 microversion: 2.1 time: 0.149611 Aug 29 22:40:54.725556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 13/26] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:54 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:55.399626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-602655391", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "networks": [{"uuid": "f93a61cd-da5c-42a0-b9db-a4c6949cf0ec"}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:40:55.662543 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] validate_networks() for [('f93a61cd-da5c-42a0-b9db-a4c6949cf0ec', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:40:55.740125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4ed75e92-4345-43a1-96f0-63f9141d60c6 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7ad13a0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:55.812589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4ed75e92-4345-43a1-96f0-63f9141d60c6 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 200 len: 344 microversion: 2.1 time: 0.078296 Aug 29 22:40:55.813151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 14/27] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:55 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:56.825887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cca34b95-7959-429c-97fc-85ae97a13202 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b5e310>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:56.914452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-cca34b95-7959-429c-97fc-85ae97a13202 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] HTTP exception thrown: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cca34b95-7959-429c-97fc-85ae97a13202 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Request method failure captured: Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 HTTP/1.1 Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUBqH9TM884jU3UeyMr_aUGnce_e7UHihFOrDj7AoSCx6MM3BLWRzRNQZe9cG_1JoLhsb02pdZdAbWrFDewcdI1guB366ucS2PlTLaQejG6DF925TY9X7WJmwP3cuJwz3JPiGq9QMSBey1fGp2sdBKez71y6c-hP50TrfH8S3bzCick Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:40:56.918665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ff9bc95c0e074f66a511f524154b70bf", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}] Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 298bfaf3cc0d478093d3ee97a3c1e734 Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'ab650e71-23c7-4a4e-af4c-0b361c5bb2d1'} Aug 29 22:40:56.920032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. (HTTP 404) (Request-ID: req-221aca6d-59ca-4b22-9039-e0d2806eb74a) Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:56.920801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:56.922627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:40:56.923963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:56.924972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:56.927464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cca34b95-7959-429c-97fc-85ae97a13202 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Returning 404 to user: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:40:56.928623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cca34b95-7959-429c-97fc-85ae97a13202 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 404 len: 109 microversion: 2.1 time: 0.106668 Aug 29 22:40:56.929648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 15/28] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:56 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:40:56.944942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2d995288-3f2e-4102-8ce2-72fe74bd00a8 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7ad19d0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:57.013573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-2d995288-3f2e-4102-8ce2-72fe74bd00a8 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] HTTP exception thrown: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2d995288-3f2e-4102-8ce2-72fe74bd00a8 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Request method failure captured: Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 HTTP/1.1 Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUBqH9TM884jU3UeyMr_aUGnce_e7UHihFOrDj7AoSCx6MM3BLWRzRNQZe9cG_1JoLhsb02pdZdAbWrFDewcdI1guB366ucS2PlTLaQejG6DF925TY9X7WJmwP3cuJwz3JPiGq9QMSBey1fGp2sdBKez71y6c-hP50TrfH8S3bzCick Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:40:57.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ff9bc95c0e074f66a511f524154b70bf", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}] Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 298bfaf3cc0d478093d3ee97a3c1e734 Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'ab650e71-23c7-4a4e-af4c-0b361c5bb2d1'} Aug 29 22:40:57.017420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. (HTTP 404) (Request-ID: req-c5ce67d6-8814-4ea3-9ebd-a1ae467a9aca) Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.018139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:40:57.022907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:40:57.023962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2d995288-3f2e-4102-8ce2-72fe74bd00a8 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Returning 404 to user: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2d995288-3f2e-4102-8ce2-72fe74bd00a8 tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 404 len: 109 microversion: 2.1 time: 0.077967 Aug 29 22:40:57.025031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 16/29] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:40:56 2022] DELETE /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:40:57.027497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e80dfb21-a848-4648-9b1b-4ac95c0abb3e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Calling method '.version_select at 0x7f5cf7b5eaf0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:57.130562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-e80dfb21-a848-4648-9b1b-4ac95c0abb3e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] HTTP exception thrown: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e80dfb21-a848-4648-9b1b-4ac95c0abb3e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Request method failure captured: Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 HTTP/1.1 Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUBqH9TM884jU3UeyMr_aUGnce_e7UHihFOrDj7AoSCx6MM3BLWRzRNQZe9cG_1JoLhsb02pdZdAbWrFDewcdI1guB366ucS2PlTLaQejG6DF925TY9X7WJmwP3cuJwz3JPiGq9QMSBey1fGp2sdBKez71y6c-hP50TrfH8S3bzCick Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:40:57.132982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ff9bc95c0e074f66a511f524154b70bf", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ff9bc95c0e074f66a511f524154b70bf"}]}] Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: ff9bc95c0e074f66a511f524154b70bf Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-955937589 Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 298bfaf3cc0d478093d3ee97a3c1e734 Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-955937589-project Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'ab650e71-23c7-4a4e-af4c-0b361c5bb2d1'} Aug 29 22:40:57.134449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. (HTTP 404) (Request-ID: req-e5994790-93d7-4cf7-9b31-0eba113dfea1) Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.135353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:40:57.136541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:40:57.137649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. Aug 29 22:40:57.139129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:40:57.141566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e80dfb21-a848-4648-9b1b-4ac95c0abb3e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] Returning 404 to user: Volume ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:40:57.142793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e80dfb21-a848-4648-9b1b-4ac95c0abb3e tempest-VolumesSnapshotsTestJSON-955937589 tempest-VolumesSnapshotsTestJSON-955937589-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1" status: 404 len: 109 microversion: 2.1 time: 0.120132 Aug 29 22:40:57.143934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 17/30] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:40:57 2022] GET /compute/v2.1/os-volumes/ab650e71-23c7-4a4e-af4c-0b361c5bb2d1 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:40:58.016905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:40:58.016905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:40:58.016905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:40:58.016905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:40:58.019034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:40:58.074051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:58.075017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:58.075748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:58.077086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:40:58.078421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:40:58.079163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:40:58.190708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Getting quotas for project 5b5cee4eb87f4428aa0c68502f2eaab1. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:40:58.218982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Getting quotas for user 72c45a0b5705455c8bb3f09053e325cf and project 5b5cee4eb87f4428aa0c68502f2eaab1. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:40:58.262449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:40:58.286415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:40:58.534491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8206b0c4-5843-46c4-9aa7-9f26f7b9b2e6 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317612 Aug 29 22:40:58.536194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 14/31] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:40:58.553671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-da91a376-d9f1-46e3-b74d-14e31d8e4899 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:58.557906 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-da91a376-d9f1-46e3-b74d-14e31d8e4899 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:40:59.530920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-da91a376-d9f1-46e3-b74d-14e31d8e4899 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:40:59.579264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-da91a376-d9f1-46e3-b74d-14e31d8e4899 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1214 microversion: 2.1 time: 1.034793 Aug 29 22:40:59.584112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 18/32] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:40:58 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1214 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:00.601017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c14d0f05-70a2-44f3-9591-81d182ff42dd tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:00.601780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c14d0f05-70a2-44f3-9591-81d182ff42dd tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:00.867665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c14d0f05-70a2-44f3-9591-81d182ff42dd tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:00.901325 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c14d0f05-70a2-44f3-9591-81d182ff42dd tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1214 microversion: 2.1 time: 0.304773 Aug 29 22:41:00.921017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:00 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1214 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:01.929249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:01.929869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:01.941869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:01.951495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:01.956470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:01.958291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:01.958985 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:01.960295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:02.991965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:03.039855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d49462e2-bb47-485b-9a78-f8facda653e5 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1266 microversion: 2.1 time: 1.115719 Aug 29 22:41:03.041488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 19/34] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:01 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1266 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:03.557902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4725b4ed-0c81-4915-b8c0-e0607e31c076 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: .version_select at 0x7f5cf7218700>, body: {"keypair": {"name": "tempest-keypair-692840648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzkIeMx7cvLP3ka9zOlfsOAZUiv9u203sTTTHA4bqA9bzEIriwlp2DYqyAQ1kNjyIcdq9qJ3vVF3iYiUFruxYcRmbgrcTLxPmgZmdlqu8kpQIGbvKRrYjNcObjA9Zd2BA=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:03.660104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-4725b4ed-0c81-4915-b8c0-e0607e31c076 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for project cf0dd257dea04aca845b17f51e1c200e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:03.680316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-4725b4ed-0c81-4915-b8c0-e0607e31c076 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for user 70da750fbe764462b50dc0fcef3eb0e6 and project cf0dd257dea04aca845b17f51e1c200e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:03.769871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4725b4ed-0c81-4915-b8c0-e0607e31c076 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.009278 Aug 29 22:41:03.772455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 16/35] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:41:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:04.065589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:04.067356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:04.080508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:04.081771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:04.083116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:04.086018 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:04.088719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:04.095629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:04.420050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:04.434465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4a18694e-9de8-4e43-869b-c7ad13fbe4df tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1272 microversion: 2.1 time: 0.372976 Aug 29 22:41:04.438496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 20/36] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:04 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:05.464092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:05.464726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:05.480483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:05.486583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:05.493307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:05.494460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:05.495191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:05.500001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:06.453307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:06.493741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7b5e1938-ac58-4bc5-b162-9c4b2c017727 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1272 microversion: 2.1 time: 1.028257 Aug 29 22:41:06.518443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 17/37] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:05 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1272 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:06.744056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a148022-8059-480b-801d-66aa039d9cea tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: .version_select at 0x7f5cf79d5ee0>, body: {"keypair": {"name": "tempest-keypair-1476472244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeV0TlnNKK0XcKB4GvfDyPd/swJgvfyasN8mHHId7CZOdwleWiPiCTG2srJJE4fSJ1f029SOgsNb0b63ZqAB9CBS45e2UaCupBltpK/JJ2uD7kxTBJxUrLm44YeQslDMA=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:07.012631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-4a148022-8059-480b-801d-66aa039d9cea tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:07.037148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-4a148022-8059-480b-801d-66aa039d9cea tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:07.310513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4a148022-8059-480b-801d-66aa039d9cea tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.820794 Aug 29 22:41:07.328531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 21/38] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:41:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:07.499590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9d45d09a-6417-43c4-b7e9-fb1891cacee6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: .version_select at 0x7f5cf7161700>, body: {"keypair": {"name": "tempest-keypair-123635756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI46daY9t8LgybZIHY53pNRvCrP3V1GI5ZUzh2E2L89a5rdfdkYu8lqGoeOOfTfuZwkWtI/nih6lFC2VnVSariKPPJr5WCq7oqTO33t/AWSN1EmKQchqXVtXMNgRYphUlg=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:07.522539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:07.523901 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:07.542061 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:07.543711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:07.544396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:07.545150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:07.547982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:07.549380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:07.628839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-9d45d09a-6417-43c4-b7e9-fb1891cacee6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:07.683612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-9d45d09a-6417-43c4-b7e9-fb1891cacee6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for user 003dd6612cda48618966db8c0788b794 and project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:07.819057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9d45d09a-6417-43c4-b7e9-fb1891cacee6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.292573 Aug 29 22:41:07.822044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 18/39] 10.222.0.77 () {62 vars in 1200 bytes} [Mon Aug 29 22:41:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1303 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 22:41:09.493016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:09.508499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2e49daa9-75f1-41c8-9570-21112f0a7369 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 1.990371 Aug 29 22:41:09.515200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 22/40] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:07 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:10.529198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:10.554252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:10.557273 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:10.586586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:10.587281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:10.589401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:10.596866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:10.597566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:10.599036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:11.708004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:11.739916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b3fae9fe-915e-4379-8f79-8fa2ab9d6556 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 1.211278 Aug 29 22:41:11.746000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 19/41] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:10 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:12.766122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:12.767604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:12.785682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:12.786197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:12.791490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:12.796381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:12.803667 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:12.804260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:14.532716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:14.574314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-abfe3416-bc74-44a8-8f05-a57bf951c8eb tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 1.811967 Aug 29 22:41:14.588535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 23/42] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:12 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:14.824899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-152764668", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b66f117d-e67e-472b-adb6-20d24f75e534"}], "security_groups": [{"name": "tempest-securitygroup--94296267"}], "key_name": "tempest-keypair-692840648", "user_data": "}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:15.120686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] validate_networks() for [('b66f117d-e67e-472b-adb6-20d24f75e534', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:41:15.146030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-722546764", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2d0869-f5f7-40a7-9c40-ad66d99bd892"}], "security_groups": [{"name": "tempest-securitygroup--1401352152"}], "key_name": "tempest-keypair-123635756", "user_data": "}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:15.824411 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] validate_networks() for [('eb2d0869-f5f7-40a7-9c40-ad66d99bd892', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:41:16.262514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:41:16.263682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:41:16.264995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:41:16.265507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:41:16.266018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:41:16.277168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:16.278052 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:16.278785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:16.279808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:16.280512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:16.281152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:16.303891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for project cf0dd257dea04aca845b17f51e1c200e. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:16.310007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for user 70da750fbe764462b50dc0fcef3eb0e6 and project cf0dd257dea04aca845b17f51e1c200e. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:16.324334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:41:16.326990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:41:16.396006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-502cdea8-0021-4f07-abc6-a463de52aae1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.575903 Aug 29 22:41:16.405538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 20/43] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:41:14 2022] POST /compute/v2.1/servers => generated 400 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:41:16.885596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59", "tag": "c3f0935d-657d-4918-a1cf-10cf49337110"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:16.939424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:16.939988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:16.940366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:16.985206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Creating event network-changed:c3f0935d-657d-4918-a1cf-10cf49337110 for instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 on hv-cinder-85427 Aug 29 22:41:16.985990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=148456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:41:16.986873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-19d04376-8ab3-4ba7-86b8-e81007cbc842 req-c1015ba1-1120-4a0b-a88e-4ae439329236 service nova] Acquired lock "compute-rpcapi-router" {{(pid=148456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:41:16.988257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:16.989034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:16.989678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:16.990691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:16.992514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:16.993313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:17.008315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.compute.rpcapi [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:41:17.009434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] Releasing lock "compute-rpcapi-router" {{(pid=148456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:41:17.037168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7c0509c0-3a96-4348-ade8-ed643e750713 None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.637082 Aug 29 22:41:17.042629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 21/44] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:17.072677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:17.078798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:17.105746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:17.110937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:17.112195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:17.113960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:17.117205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:17.118995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:17.126570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=6 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:17.142112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:41:17.142929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:41:17.143754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:41:17.144497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:41:17.146082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:41:17.199100 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:17.199510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:17.199913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:17.200638 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:17.201086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:17.202034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:17.265998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:17.277483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for user 003dd6612cda48618966db8c0788b794 and project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:17.330192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:41:17.335368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:41:17.463532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cc699d9b-b2fa-454c-96d2-7ea899c01f91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.323021 Aug 29 22:41:17.472514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 24/45] 10.222.0.77 () {62 vars in 1188 bytes} [Mon Aug 29 22:41:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 22:41:17.480082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1510650705", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4fab7c6-be28-40e9-82ea-67b0ac291d9e"}], "security_groups": [{"name": "tempest-securitygroup--437098532"}], "key_name": "tempest-keypair-1476472244", "user_data": "}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:17.517400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:17.534587 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-add0df57-6022-477e-91dc-30072e2ab2a1 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.488262 Aug 29 22:41:17.535246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 22/46] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:17 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:17.561731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-00a82ce2-24db-4c74-b106-fa04c361d1f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:17.562361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-00a82ce2-24db-4c74-b106-fa04c361d1f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:17.910930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-00a82ce2-24db-4c74-b106-fa04c361d1f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:17.925039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-00a82ce2-24db-4c74-b106-fa04c361d1f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1236 microversion: 2.1 time: 0.368984 Aug 29 22:41:17.928606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 23/47] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:17 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1236 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:17.949142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:17.949769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:18.150387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] validate_networks() for [('c4fab7c6-be28-40e9-82ea-67b0ac291d9e', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:41:18.169318 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:18.203686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:18.221144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:18.222990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5655a2c9-3955-4b27-b3a7-f6e6c0c8413d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1280 microversion: 2.20 time: 0.288367 Aug 29 22:41:18.228594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 24/48] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:17 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:18.557924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:18.559575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:18.578704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:18.586043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:18.586781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:18.587868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:18.588616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:18.589237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:18.930992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:18.939874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a6efefa8-1b08-491e-a48d-05448d129824 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.385821 Aug 29 22:41:18.940584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 25/49] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:18 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:18.957620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:18.958681 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:18.971906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:18.972558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:18.973601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:18.974522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:18.976055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:18.977289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:18.991028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:41:18.991583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:41:18.992186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:41:18.992662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:41:18.993192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:41:19.008702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.009329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.009978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:19.011030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.011592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.012128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:19.037867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:41:19.052568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:41:19.075676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:41:19.082229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:41:19.083282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:19.093299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c2785df3-7d9a-4d31-ac1d-0ec0f2f25f55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1240 microversion: 2.1 time: 0.146470 Aug 29 22:41:19.094396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 26/50] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:18 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:19.149414 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fd77d938-f78d-4770-910b-30cdaaaa4126 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.674430 Aug 29 22:41:19.151267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:41:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:41:19.164511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ccdaeceb-54b4-4520-9415-28e8955061e5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:19.165626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ccdaeceb-54b4-4520-9415-28e8955061e5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:19.246211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:19.247226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:19.256040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ccdaeceb-54b4-4520-9415-28e8955061e5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:19.267187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ccdaeceb-54b4-4520-9415-28e8955061e5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1242 microversion: 2.1 time: 0.108370 Aug 29 22:41:19.270868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 27/52] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:19 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:19.272729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.273456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.274090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:19.275015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.276196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.276828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:19.353920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:19.364691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:19.366433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:19.367810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-48fe8c10-f3e6-4ba1-ba99-5eefda9116bf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1284 microversion: 2.20 time: 0.125906 Aug 29 22:41:19.388445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 26/53] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:19 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:19.969665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:19.972084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:19.979052 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.986869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.987711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:19.989030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:19.989809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:19.990451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.117767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:20.118759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:20.134425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.135392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.135879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.137021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.138975 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.139409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.378129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.393938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e3ea4bec-8631-45fd-817d-1c1133cfedcc tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1240 microversion: 2.1 time: 0.279783 Aug 29 22:41:20.397561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 27/54] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:20 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1240 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:20.405702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.422480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bdbebb49-1c6b-4950-bf75-20d4f125b3cc tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.463263 Aug 29 22:41:20.424596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:20.425754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:20.439076 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 28/55] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:19 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:20.441553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.445237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:20.445874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:20.454244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.457354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.458135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.458612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.459069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.470817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.471321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.471764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.479155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:20.479711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:20.480196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:20.716263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.738071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dc7351ce-1cdd-4c06-ab7a-829636ebc850 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1246 microversion: 2.1 time: 0.334633 Aug 29 22:41:20.739178 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 28/56] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:20 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1246 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:20.739507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.751630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.755201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:20.756627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c538db44-4a8f-4207-8da9-7d7718550284 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1284 microversion: 2.20 time: 0.327374 Aug 29 22:41:20.757403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 29/57] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:20 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:21.422773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:21.425065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:21.432445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.433257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.434014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.435319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.436014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.436717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.468695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:21.469340 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:21.479721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.481009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.481731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.483269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.483965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.484654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.525017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.541920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8f41c27f-7e80-443e-ae22-237ae2cbfe75 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1240 microversion: 2.1 time: 0.125121 Aug 29 22:41:21.542604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 29/58] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:21 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:21.676903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.685258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1b7234fd-8ac9-49f2-8b96-87c3df9c3b2e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.221142 Aug 29 22:41:21.687417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 30/59] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:21 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:21.782185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:21.782830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:21.787049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:21.787665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:21.794382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.794968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.795910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.796604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.797057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.797473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.804800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.805508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.805940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.806899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:21.807615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:21.808110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:21.924606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.933883 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-bf0dc339-84d8-41ea-a60c-59a5f968a5a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1246 microversion: 2.1 time: 0.160136 Aug 29 22:41:21.934457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 30/60] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:21 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:21.961272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.977777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.979685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:21.980808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5010bf9d-e0b7-40b9-b967-dd65de668fe4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1284 microversion: 2.20 time: 0.204023 Aug 29 22:41:21.981362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 31/61] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:21 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:22.562769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:22.563417 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:22.569597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.570117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.570626 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:22.571482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.571978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.572551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:22.642236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:22.651531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ab4186b3-5abb-485c-ad75-28df081b592e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1240 microversion: 2.1 time: 0.093047 Aug 29 22:41:22.652275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 31/62] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:22 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:22.708029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:22.708637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:22.714502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.715017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.715447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:22.716126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.716582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.717238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:22.850430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:22.852832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=67 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:22.860318 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2101441f-9185-49da-8170-ce48496e4ba9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.156111 Aug 29 22:41:22.860888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 32/63] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:22 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:22.960337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:22.960952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:22.967314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.967801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.968305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:22.969099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:22.970021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:22.970537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.017939 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:23.018562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:23.021605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:23.028004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.028713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.029550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.030612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.031428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.031887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.150579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:23.162200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-70d0e0a5-9a78-445f-82e8-eee911a895ba tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1246 microversion: 2.1 time: 0.204035 Aug 29 22:41:23.164486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 32/64] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:22 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1246 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:23.171934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:23.188794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:23.195563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:23.198451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ba868cae-8317-4de4-91e2-2a4860182d9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1284 microversion: 2.20 time: 0.188229 Aug 29 22:41:23.202852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 33/65] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:23 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:23.673818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:23.674519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:23.680631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.681277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.681843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.682634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.683195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.683733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.751075 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:23.758932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9ecb6ead-0d98-44cf-87f5-9ed93723578c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.089826 Aug 29 22:41:23.759492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 33/66] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:23 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:23.882235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:23.883270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:23.890604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.891470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.892046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:23.892935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:23.893481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:23.893963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.032537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.040235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-90b12bc7-cc68-4255-838c-5e5cb91c65c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.162883 Aug 29 22:41:24.040797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 34/67] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:23 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:24.183652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:24.184276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:24.190876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.191359 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.191784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.192464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.193060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.193486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.224960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:24.225650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:24.231798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.232473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.233061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.234131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.234721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.235304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.260976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.270000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-72301744-526f-4b5d-bd00-32517cb87915 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.090220 Aug 29 22:41:24.270790 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 34/68] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:24 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:24.303009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.309741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.311730 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.312819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7631d517-9eef-4886-9210-a29230717597 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.092288 Aug 29 22:41:24.313986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 35/69] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:24 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:24.783838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:24.790634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:24.798464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.799074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.799519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.800254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:24.800738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:24.801226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:24.867984 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:24.876242 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cc49bb95-9130-40e7-9dd0-e79e2d0b932e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.099771 Aug 29 22:41:24.876821 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 35/70] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:24 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:25.061714 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:25.062687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:25.069197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.069883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.070350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.071086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.071538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.071958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.207833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.215356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d0236244-1886-4575-bc32-a0cfbe8722bf tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.158463 Aug 29 22:41:25.215905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 36/71] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:25 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:25.291538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:25.292082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:25.299290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.299768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.300199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.300884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.301331 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.301748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.338744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:25.339393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:25.345788 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.346476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.346955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.347655 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.348114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.348536 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.364668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.372087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e2b5fe2e-b117-4c68-b33d-2757f601867d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.084641 Aug 29 22:41:25.372678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 36/72] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:25 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:25.410692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.418673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.420685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.421769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f90c9cf4-aa38-481b-af05-9d08f4b9e078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.086950 Aug 29 22:41:25.422324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 37/73] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:25 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:25.898161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:25.898780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:25.905138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.905601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.906023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.906696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:25.907179 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:25.907594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:25.969616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:25.973203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:25.978074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-da38879c-dc06-4dc0-814c-fa0021a7584b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.083768 Aug 29 22:41:25.978621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 37/74] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:25 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:26.235572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:26.236209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:26.242269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.242771 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.243210 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.243925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.244376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.244802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.371889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:26.380056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3fa4406c-39a5-4cfa-aa51-1699aba3f14a tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.148320 Aug 29 22:41:26.380638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 38/75] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:26 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:26.393743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:26.394356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:26.401112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.401597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.402031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.402765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.403395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.403820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.445458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:26.446057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:26.452820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.453299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.453715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.454808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:26.455321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:26.455741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:26.469963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:26.478036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2746a756-6004-4d46-b451-f01a95ed27c1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.088882 Aug 29 22:41:26.478835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 38/76] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:26 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:26.523078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:26.531907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:26.533340 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:26.534431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d147e6f0-9918-4195-b8d7-9c5c05c9d041 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.093815 Aug 29 22:41:26.535622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 39/77] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:26 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:26.998379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:26.999008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:27.000824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:27.006602 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.007107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.007540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.008228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.008700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.009110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.071575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.079570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c45c6c00-062d-43f1-8617-4872567105f5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.085067 Aug 29 22:41:27.080140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 39/78] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:26 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:27.400920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:27.406912 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:27.407669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:27.422661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.423194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.423665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.424438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.425036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.425600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.500337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:27.501453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:27.507680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.508278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.508789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.509667 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.510545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.511222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.588782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.592396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.596652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-81ee7f21-5045-436c-bbfb-c971a3927b67 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.100932 Aug 29 22:41:27.597224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 40/79] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:27 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:27.601224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e2e88ee0-2a44-435c-b276-01a4417d39da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.201295 Aug 29 22:41:27.601783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 40/80] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:27 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:27.603623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:27.604233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:27.610575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.611081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.611941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.612631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:27.613056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:27.613474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:27.676120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.684115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.686295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:27.687418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cedc06f9-9fb6-40fb-a13e-13a57827fb57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.089185 Aug 29 22:41:27.687970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 41/81] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:27 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:28.099934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:28.100471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:28.106461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.106987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.107422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.108109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.108560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.108982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.170512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.178312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1a03f0d5-1e44-4543-b3c5-3d5f52fe1631 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.082282 Aug 29 22:41:28.179092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 41/82] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:28 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:28.618645 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:28.619326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:28.621237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:28.621854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:28.625888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.626377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.626855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.627636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.628094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.628198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.628520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.628653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.629090 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.629781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.630239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.630665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.713608 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.722384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8ae106ec-4a2f-4b70-b995-a76ae3daed9e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.107597 Aug 29 22:41:28.735777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 42/83] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:28 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:28.735777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:28.735777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:28.735777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.742919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.744125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.745127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:28.745632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:28.746474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:28.796343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.819067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a9f7e959-93b6-4af3-84fb-1099a06dbf97 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.199633 Aug 29 22:41:28.819067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 42/84] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:28 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:28.834415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.842832 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.844268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:28.845643 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7e98c20e-aee9-4f82-9969-ddd243f3d0d1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.121732 Aug 29 22:41:28.846309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 43/85] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:28 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:29.198298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:29.198970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:29.206054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.206533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.206988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.207682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.208130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.208550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.265893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=28 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:29.275612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:29.283598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-de6f4559-d06d-415e-bed1-2c982bc1ec10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.089304 Aug 29 22:41:29.284163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 43/86] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:29 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:29.743135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:29.743759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:29.745620 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:29.746266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=12 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:29.752442 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.752917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.753340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.754029 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.754476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.754919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.818506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:29.830994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e7c853e5-4d59-485d-acb9-a1bb12fd499e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.091575 Aug 29 22:41:29.831568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 44/87] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:29 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:29.838414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:29.839088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:29.845887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.846363 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.846828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.847516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.847970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.848393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.868461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:29.869085 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:29.874901 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.875378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.875801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.876506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:29.877084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:29.877476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:29.949192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:29.958260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:29.959742 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:29.960845 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a0840b7c-ea34-42da-b272-2181d19684f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.096236 Aug 29 22:41:29.961396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 45/88] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:29 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:30.005524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:30.013103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d8ffd110-9162-4958-8d6b-ea1eb97ff4af tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.178490 Aug 29 22:41:30.014263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 44/89] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:29 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:30.304460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:30.305083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:30.311713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.312463 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.313496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:30.314312 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.314904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.315426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:30.389483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:30.401214 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a13f4be1-951f-487d-863d-46f9f56947f8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1288 microversion: 2.1 time: 0.100276 Aug 29 22:41:30.402297 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 46/90] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:30 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:30.852897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:30.853510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:30.866226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.866702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.867164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:30.867875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.868403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.869008 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:30.957997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:30.968133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b9263430-b6e6-4987-83b7-a30ff21109a1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.118912 Aug 29 22:41:30.978763 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 45/91] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:30 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:30.984749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:30.985578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:30.993291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.993772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.994187 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:30.995004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:30.995353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:30.996334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.035006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:31.035791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:31.043644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:31.044537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:31.045171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.046048 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:31.046766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:31.047278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.071224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:31.082513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:31.084068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:31.085179 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5dd33c0c-33ba-4099-a8db-d25927562697 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1332 microversion: 2.20 time: 0.105557 Aug 29 22:41:31.085718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 47/92] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:30 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:31.281514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:31.289518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c998baab-7e3b-4c11-96a4-8cb5ae97e7be tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.258827 Aug 29 22:41:31.290235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 46/93] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:31 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:31.423766 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:31.424416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:31.430397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:31.430918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:31.431402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.432040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:31.432500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:31.432927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.494845 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:31.503028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ec40a2d2-5093-4b08-9528-7ede3816e086 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1296 microversion: 2.1 time: 0.083521 Aug 29 22:41:31.503675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 48/94] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:31 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:31.992119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:31.992119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:31.997949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:31.998438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:31.999085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:31.999857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.000314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.000747 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.067554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.076656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5cf06622-4670-4a04-9194-3af613488a00 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.089501 Aug 29 22:41:32.086762 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 47/95] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:31 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:32.109352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:32.110615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:32.116829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.117409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.117857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.118572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.119115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.119865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.187653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.196481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.197924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.199251 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-14db7b74-ed00-4435-b83b-d41b3257323b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1340 microversion: 2.20 time: 0.093808 Aug 29 22:41:32.199813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 49/96] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:32 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:32.312506 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:32.313241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:32.319289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.319768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.320191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.320876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.321315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.321915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.515855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.524709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f8eada6b-8f07-4073-b954-7b28b1d03235 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.217485 Aug 29 22:41:32.538769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:32.538769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:32.538769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.538769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.539187 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.540000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 48/97] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:32 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:32.540217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:32.540910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:32.541333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:32.625939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:32.647275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d3a8f42d-a6ca-456f-8eaf-393124b052fa tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1296 microversion: 2.1 time: 0.127935 Aug 29 22:41:32.659594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 50/98] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:32 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:33.099891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:33.100508 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:33.107008 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.107496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.107930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.108623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.109071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.109494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.125622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:33.191484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.211561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cb732f31-ba4b-4e59-8948-5c250231e65a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1294 microversion: 2.1 time: 0.116709 Aug 29 22:41:33.212387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 49/99] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:33 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:33.227219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:33.227924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:33.235226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.236364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.236551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.237404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.238046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.238453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.306239 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.319249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.320711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.321820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cea793e7-86f7-4455-a123-56220d949b27 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1340 microversion: 2.20 time: 0.102376 Aug 29 22:41:33.322551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 51/100] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:33 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:33.546509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:33.547265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:33.554239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.554825 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.555340 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.556101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.556625 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.557142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.671291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:33.672799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:33.679116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.679895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.680518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.681427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:33.681976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:33.682590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:33.703841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.712075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c2a781cf-e438-4ce3-a6b7-afbcd3c58be8 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.170398 Aug 29 22:41:33.712834 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 50/101] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:33 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:33.764965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:33.774653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f84d2a40-74b4-43e1-b2c6-610efdf35754 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1296 microversion: 2.1 time: 0.109220 Aug 29 22:41:33.775370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 52/102] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:33 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:34.239431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:34.240829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:34.250958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.253258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.253854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.256214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.259038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.259811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.353432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:34.354711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:34.366201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.367009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.367593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.368464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.371458 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.372347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.516237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:34.531490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5eb1c3a9-e017-48df-862d-e752259046ca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1312 microversion: 2.1 time: 0.297976 Aug 29 22:41:34.534782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 51/103] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:34 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:34.690158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:34.707300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:34.709911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:34.711455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8549fada-7c93-4b31-ae6e-e9c1df29507c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1338 microversion: 2.20 time: 0.368706 Aug 29 22:41:34.712211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 53/104] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:34 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:34.737737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:34.738376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:34.754643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.757401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.758987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.763340 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.764238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.766130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.797279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:34.798237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:34.805987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.806764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.807456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.808391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:34.809518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:34.810224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:34.848023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:34.907387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:34.918785 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2f992f9d-dc02-4073-a903-8ece6dbefe8d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1294 microversion: 2.1 time: 0.126186 Aug 29 22:41:34.921730 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 54/105] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:34 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:35.328199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:35.343314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1d2138e0-febc-4d24-b273-ae85d9e67cef tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.611679 Aug 29 22:41:35.344261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 52/106] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:34 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:35.559108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:35.563451 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:35.578315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.579045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.580252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:35.581616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.582692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.583430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:35.723853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:35.736729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-47813c53-7a12-410a-b595-a7be5c70efb2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1300 microversion: 2.1 time: 0.184532 Aug 29 22:41:35.738867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 55/107] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:35 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:35.755929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:35.756919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:35.766962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.767799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.768686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:35.769659 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.770342 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.771324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:35.895317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:35.908515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:35.910169 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:35.911335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2823e11a-f961-4a47-b6c4-ec7bc8c09f54 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1338 microversion: 2.20 time: 0.179303 Aug 29 22:41:35.912160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 53/108] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:35 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:35.941973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:35.942993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:35.949884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.952613 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.954963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:35.956791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:35.957605 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:35.959253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:36.089352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:36.115606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-70a9b340-8341-42b9-bf60-03b4c0348aa5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1294 microversion: 2.1 time: 0.175500 Aug 29 22:41:36.117844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 56/109] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:35 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1294 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:36.365291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:36.366134 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:36.375541 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:36.378034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:36.380126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:36.381202 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:36.382368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:36.383815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.025665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:37.029180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59", "name": "network-vif-plugged", "status": "completed", "tag": "c3f0935d-657d-4918-a1cf-10cf49337110"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:37.039467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e6bd8072-d0a1-4886-84a4-f83b88d32520 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.678408 Aug 29 22:41:37.057598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.058276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.058932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.059211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 54/110] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:36 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:37.070767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:37.078036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:37.088933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.092176 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.093116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.094154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.095447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.097985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.118952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Creating event network-vif-plugged:c3f0935d-657d-4918-a1cf-10cf49337110 for instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 on hv-cinder-85427 Aug 29 22:41:37.119929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=148457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:41:37.120556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d1af2d3c-bcb3-4a03-9352-735e3e5e4c4c req-9e051bb2-cdcb-4f38-b680-8688e8f8677a service nova] Acquired lock "compute-rpcapi-router" {{(pid=148457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:41:37.124882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.130106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.133260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.138613 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.141578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.142503 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.168396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.compute.rpcapi [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:41:37.170868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=148457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:41:37.206369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d122b9c3-b440-4370-b342-a512f813d0b9 None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456518 Aug 29 22:41:37.209632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 57/111] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:41:37.223225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:37.224259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:37.239440 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.242184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.242831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.246382 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.248742 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.250501 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.656233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:37.675949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:37.691135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:37.699515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ccb6a912-836b-4a99-a23e-4ee1890c020c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.486189 Aug 29 22:41:37.716143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 58/112] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:37 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:37.722901 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:37.723522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:37.742885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.743339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.743772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.744486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:37.744940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:37.745364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:37.811009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:37.831062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2c856e85-d9cb-4946-8cc3-0980c1d584c3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.764246 Aug 29 22:41:37.834141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 55/113] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:37 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:38.065407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:38.066919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:38.073422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.073889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.074558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.075887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.076560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.077076 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.114074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:38.125887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-67c69dac-fe31-4fd3-9099-be597f319a73 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.408617 Aug 29 22:41:38.126473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 59/114] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:37 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:38.363629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:38.377559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f3d727ad-2121-47c4-88fc-38281c50a9f2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.315532 Aug 29 22:41:38.378302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 56/115] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:38 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:38.513235 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48a61e3-953a-41a2-a47f-96f40b362e3e", "tag": "f190fef4-1aa0-400e-be49-90c39442815f"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:38.530181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.531512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.534824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.550243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] Creating event network-changed:f190fef4-1aa0-400e-be49-90c39442815f for instance e48a61e3-953a-41a2-a47f-96f40b362e3e on hv-cinder-85427 Aug 29 22:41:38.555523 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-15eabd9b-e48c-4207-b856-f773d81b6be0 req-1cf2c741-519c-42ae-af8b-c47486e77cb3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050999 Aug 29 22:41:38.556489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 60/116] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:38.741939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:38.743245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:38.750473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.751112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.751747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.752656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.753197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.753680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.859129 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f655b3-78d2-40f5-ac78-806952dba34b", "tag": "62afccef-e8d2-4fce-8052-0f7da6e93ebc"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:38.868755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.869228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.869656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.892813 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] Creating event network-changed:62afccef-e8d2-4fce-8052-0f7da6e93ebc for instance 69f655b3-78d2-40f5-ac78-806952dba34b on hv-cinder-85427 Aug 29 22:41:38.898393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-31604452-37ff-4ae5-9c1d-a9284aff3672 req-7d08d8e0-7065-4f1e-a93e-ae56824e7f22 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198372 Aug 29 22:41:38.899444 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 57/117] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:38.905313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:38.906322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:38.913227 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.914373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.915034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.915933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:38.916565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:38.917352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:38.919628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:38.933761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:38.936244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:38.937879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-91ba2991-2219-4931-a743-d17a25343cba tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.200121 Aug 29 22:41:38.938604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 61/118] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:38 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:39.103026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:39.111425 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2693c6b8-1d2b-4335-90aa-4238fdf458db tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.210548 Aug 29 22:41:39.112460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 58/119] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:38 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:39.151329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:39.151948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:39.158109 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.158592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.159063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:39.159753 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.160199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.160619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:39.301777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:39.309612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3d94b64f-f4c2-45fb-ab44-1e9d99c5fa2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.162835 Aug 29 22:41:39.311007 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 62/120] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:39 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:39.399737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:39.400374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:39.407002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.407491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.407923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:39.408841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.409045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.409470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:39.542751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:39.551539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4ef08053-d8e5-4e02-9d94-9e1970e17937 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.155656 Aug 29 22:41:39.552113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 59/121] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:39 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:39.960468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:39.961118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:39.967348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.967829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.968260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:39.969031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:39.969494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:39.970257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.136986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:40.138500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:40.146792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.147967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.148608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.149554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.150206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.150869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.768802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:40.776817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:40.788176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:40.789339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e918c51d-83a5-418e-a6e2-dd3adc1669fd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.832798 Aug 29 22:41:40.789893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 63/122] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:39 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:40.798672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:40.799818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:40.806714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.808246 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.808900 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.810601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.811440 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.811875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.817484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:40.827584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cb0d8074-3f78-41c7-b544-30140b9bffe5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.696590 Aug 29 22:41:40.837819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 60/123] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:40 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:40.842934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:40.843746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:40.862158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.862978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.863560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:40.864615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:40.865217 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:40.865799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:41.343470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:41.361291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-33eb568c-9269-41e5-a479-c6ac927d87d2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.564485 Aug 29 22:41:41.363562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 64/124] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:40 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:41.373566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:41.387653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:41.401344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:41.403245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:41.405360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-647eafbf-fa2f-4043-aed9-7aa80d1842c4 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.565699 Aug 29 22:41:41.407158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 61/125] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:40 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:41.419577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:41.432251 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] Creating event network-changed:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:41:41.437967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-4380905c-feef-4f96-87d4-fc8c882eda78 req-4c8b8737-e613-416e-976e-4c75c5938e69 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072441 Aug 29 22:41:41.441720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 65/126] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:41.814412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:41.815497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:41.825155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:41.825862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:41.826490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:41.827215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:41.827671 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:41.828091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:41.858984 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:41.859706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:41.866884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:41.867397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:41.867854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:41.868558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:41.869008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:41.869432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:42.016206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.024131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.025550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.026629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c23c69f3-2ac4-4d03-b4b7-ecb2573beddd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.217088 Aug 29 22:41:42.036945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 62/127] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:41 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:42.037234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.045347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8888a69a-5e72-46c9-9f5b-98b7b35d9daf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.191673 Aug 29 22:41:42.045910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 66/128] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:41 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:42.384744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:42.385359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:42.392332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:42.392876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:42.393124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:42.393917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:42.394397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:42.394678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:42.436420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:42.437226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:42.445337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:42.445822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:42.446257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:42.447144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:42.447595 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:42.448013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:42.586139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.595261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-be7d0ea5-a7fb-4145-aa78-63b54689bab9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.213894 Aug 29 22:41:42.595744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 63/129] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:42 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:42.614409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:42.622417 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-21fa6b71-1517-4eec-ac92-1fade557f4a7 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.198666 Aug 29 22:41:42.623101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 67/130] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:42 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:43.048807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:43.049418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:43.055372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.055848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.056279 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.056966 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.057416 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.057840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.066310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:43.067033 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:43.073905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.074448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.075045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.076547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.077059 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.077561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.261847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.266406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.274558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f425b49e-f1a7-43a9-afc0-7a39dec545e3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.212470 Aug 29 22:41:43.275487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 68/131] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:43 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:43.277600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.279730 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.280838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-df39489f-3aaf-4102-a4cd-6a44c8e85a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.235846 Aug 29 22:41:43.281389 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 64/132] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:43 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:43.616305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:43.617016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:43.624113 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.624527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.624998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.625687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.626110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.626535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.644230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:43.645034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:43.651084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.651675 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.652208 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.653521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:43.654273 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:43.654885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:43.841067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.847987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:43.849075 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-91dac43a-231b-4857-b87b-dfed3f5f4a48 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.236537 Aug 29 22:41:43.849649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 69/133] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:43 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:43.855779 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-48c63322-70a9-41da-8c8f-335c6c505ad2 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.215430 Aug 29 22:41:43.856346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 65/134] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:43 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:44.296524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:44.297130 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:44.302343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:44.302977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:44.303079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.303555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.303987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.304675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.305136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.305561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.309137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.309611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.310042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.310723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.311191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.311611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.500446 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:44.504855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:44.507309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.508579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-56ee11fc-ec5e-4a75-992e-fd1903abacaa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.216432 Aug 29 22:41:44.509160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 70/135] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:44 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:44.515841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:44.517359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:44.518559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-10e00b80-d7dc-40b7-b18c-e11bd8014fc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.220027 Aug 29 22:41:44.519219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 66/136] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:44 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:44.870762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:44.871362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:44.877038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:44.877636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:44.878163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.878652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.879096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.879779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.880218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.880634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.883491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.883965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.884546 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:44.885234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:44.885682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:44.886101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.078023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.080439 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.085855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d8307ab0-cc66-4d3a-b861-8dd6a7c24662 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.219002 Aug 29 22:41:45.086419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 71/137] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:44 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:45.088007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ceab779a-a171-4b87-b180-4af9f1ff4d8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.214807 Aug 29 22:41:45.088555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 67/138] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:44 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:45.530500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:45.531144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:45.537720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.538200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.538633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.539356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.539686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:45.539801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.540214 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.540303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:45.546124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.546594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.547057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.547773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.548295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.548651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.732472 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.735957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:45.741263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-522ed0b0-4f64-4469-9d46-dea5da61fd3e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.215157 Aug 29 22:41:45.743972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.751066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 72/139] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:45 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:45.756264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.757701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:45.758823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c4c119ee-1a6a-46a8-85a9-612e32af82c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.222950 Aug 29 22:41:45.759834 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 68/140] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:45 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:46.108773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.109063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.109522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:46.109618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:46.115685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.116131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.116310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.116584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.116745 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.117016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.117408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.117705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.117866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.118147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.118313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.118560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.319833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:46.323204 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:46.327726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cb7334b6-23b4-4f47-9e8e-49d4c334319b tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.223057 Aug 29 22:41:46.328297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 69/141] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:46.331186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c49a5dc1-c124-4887-90e6-618ecc0b69b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.227300 Aug 29 22:41:46.331774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 73/142] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:46.762114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.762720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:46.768842 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.769330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.769753 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.770438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.770934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.771361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.782014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.782680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:46.788853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.789333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.789758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.790687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.791157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.791580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.991322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.000450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2186d690-bd00-46c0-b48c-c43ff8f54de1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.242061 Aug 29 22:41:47.004074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 70/143] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:47.007114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.016550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.018481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.019668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c309cebc-26cc-48d3-8a36-8da437261653 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.242044 Aug 29 22:41:47.020241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 74/144] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:47.352843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:47.353392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:47.354158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:47.354789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:47.357910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:47.360510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:47.360994 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:47.361419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:47.361734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:47.362118 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:47.362253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:47.362564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:47.362682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:47.363006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:47.363355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:47.363801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:47.364310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:47.561734 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.565609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:47.570146 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-553dd3c1-3e40-439c-b959-af428fe39b1a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.221220 Aug 29 22:41:47.570717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 71/145] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:47 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:47.573267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ed8d8f46-57ae-4989-9e76-600bf83dbeca tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.222926 Aug 29 22:41:47.573831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 75/146] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:47 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:48.023748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:48.024362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:48.032182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.032905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.033349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.034065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.034566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.035075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.042293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:48.043059 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:48.059316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.059806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.060242 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.060954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.061406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.061818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.502499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.511191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.513279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.514385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b0404f72-7590-4c93-a6a9-e95b3c6718de tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.476236 Aug 29 22:41:48.519363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 76/147] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:48 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:48.539003 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.547929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-50fa33fe-4596-489c-8f05-a299cda60c60 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.527891 Aug 29 22:41:48.549309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 72/148] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:48 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:48.593732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:48.597602 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:48.598288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:48.598806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:48.607145 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.607625 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.608053 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.608737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.609178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.609593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.616743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.617221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.617657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.618348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:48.618814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:48.619229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:48.813717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.817641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:48.822071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ff688fba-31d8-41e3-a9a0-33fe39f60981 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1314 microversion: 2.1 time: 0.232550 Aug 29 22:41:48.822871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 73/149] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:48 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:48.826058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-756bff86-87a7-4b8c-bf28-ee4eeacbb309 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.237872 Aug 29 22:41:48.826633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 77/150] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:48 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:49.539641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:49.540252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:49.551211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.554599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.556234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.557151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.559274 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.559869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.570248 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:49.571159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:49.582662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.583229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.583669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.587417 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.591255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.591742 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.842965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:49.848563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:49.862161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-75f38b21-2235-413c-bc0f-a82851ab5dd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.296233 Aug 29 22:41:49.862913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 78/151] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:49 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:49.874918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:49.874918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:49.874918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.876257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.876257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.876257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.879614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:49.881051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:49.882289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0504f22b-40c2-492d-a1c5-875b142924e9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.347310 Aug 29 22:41:49.883042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 74/152] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:49 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:49.888970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.890801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.896468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:49.897126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:49.904225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.904801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.905303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:49.906254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:49.906801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:49.907317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:50.151345 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:50.155808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:50.164791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ee8e3b8a-b173-4484-8d46-bdd6f9debf65 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.280362 Aug 29 22:41:50.165474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 75/153] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:49 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:50.168299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c38aaa0d-bf92-4188-a233-f063f6396665 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1502 microversion: 2.1 time: 0.304301 Aug 29 22:41:50.168870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 79/154] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:49 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:50.518304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "name": "network-vif-plugged", "status": "completed", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:50.547357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:50.550592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:50.551867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:50.586919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] Creating event network-vif-plugged:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:41:50.599251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-509d78bb-7535-49b2-80d5-f0ec43b14d96 req-284d0a0e-2fa4-4a75-973d-9a6b7783fbcf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085511 Aug 29 22:41:50.601468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 76/155] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:41:50.888798 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:50.890163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:50.909849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:50.911009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:50.919603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:50.922204 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:50.924274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:50.930254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:50.930825 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:50.933809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:50.939496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:50.944421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:50.944882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:50.945607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:50.946321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:50.947247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:51.443905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:51.450823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:51.456965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:51.458218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:51.459461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-abf6cc45-4e77-46ae-99b6-088b59e3909b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.557790 Aug 29 22:41:51.460151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 77/156] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:50 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:51.466750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:51.467445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:51.470861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e3a4aa1e-4d53-4b3d-b230-b54ccd186757 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.587873 Aug 29 22:41:51.472308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 80/157] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:50 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:51.477515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:51.477999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:51.478424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:51.479142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:51.479585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:51.480292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:51.671544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:51.679596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ce970f8d-437a-4b65-894a-faf112568a4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.218215 Aug 29 22:41:51.680175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 78/158] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:51 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:51.760335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "745d7d40-db69-42f5-a1e8-e444e162837e"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:51.763327 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:51.773380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:51.779765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:51.780224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:51.781232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:51.781692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:51.782106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:52.346777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5f449ea9-0532-4953-867a-ede484b9eb1e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "POST /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590195 Aug 29 22:41:52.349009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 81/159] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:41:51 2022] POST /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:41:52.486078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:52.486692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:52.496531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:52.497914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:52.506236 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:52.506722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:52.507179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:52.507887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:52.508328 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:52.515856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:52.516341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:52.516769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:52.517467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:52.517917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:52.518336 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:52.522812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:52.952048 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:52.964013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:52.972513 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:52.973798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2297945f-5976-485b-8342-585d4fcde112 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1406 microversion: 2.20 time: 0.494713 Aug 29 22:41:52.974344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 79/160] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:52 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:52.982028 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48a61e3-953a-41a2-a47f-96f40b362e3e", "name": "network-vif-plugged", "status": "completed", "tag": "f190fef4-1aa0-400e-be49-90c39442815f"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:53.003472 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:53.011408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f4a9a8ad-3055-4bc2-bd56-5283ff5c712f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.519574 Aug 29 22:41:53.011997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 82/161] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:52 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:53.048397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:53.049047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:53.050059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:53.050783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:53.051445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:53.079396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:53.096006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:53.097238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:53.098141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:53.098770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:53.099371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:53.109757 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] Creating event network-vif-plugged:f190fef4-1aa0-400e-be49-90c39442815f for instance e48a61e3-953a-41a2-a47f-96f40b362e3e on hv-cinder-85427 Aug 29 22:41:53.120026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-97ca0c2b-1925-4474-9a3f-09732a8808e9 req-26f05dcf-e451-4ba2-b8db-a6481ab784be service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144471 Aug 29 22:41:53.120794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 80/162] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:53.421847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:53.437429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6cbc85a5-b374-4ad8-a182-c931f5875d3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.397052 Aug 29 22:41:53.438487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 83/163] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:53 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:54.029948 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.034849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:54.035813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.036538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:54.038400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=96 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:54.050326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.051196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.051885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.053553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.054239 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.055308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.070792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.073405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.074692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.078550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.079774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.081905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.450860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:54.468371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4aae6c9b-a08a-4df6-874c-07da6ad5d4a4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1367 microversion: 2.1 time: 0.438862 Aug 29 22:41:54.469115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 84/164] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:54.477915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.479303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:54.490034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.490786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.491579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.493291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.494502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.495238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.521402 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:54.536214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:54.537885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:54.541243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1f22fa08-df59-4cdd-9193-243784d6b7d5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1598 microversion: 2.20 time: 0.541597 Aug 29 22:41:54.556904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 81/165] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:41:53 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1598 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:54.605280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.606814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:54.624811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.625761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.626514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.627751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:54.628565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:54.630121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:54.739424 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:54.757093 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4d04f003-df92-4f2f-9800-1342dc2cbae0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.282737 Aug 29 22:41:54.758325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 85/166] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:54.975250 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8be5ad2e-929a-4ef6-9c48-d54b2d0d1dcb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.402428 Aug 29 22:41:54.983168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 82/167] 10.222.0.77 () {60 vars in 1316 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:55.162036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f655b3-78d2-40f5-ac78-806952dba34b", "name": "network-vif-plugged", "status": "completed", "tag": "62afccef-e8d2-4fce-8052-0f7da6e93ebc"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:55.186913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:55.187390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:55.187816 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:55.209224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] Creating event network-vif-plugged:62afccef-e8d2-4fce-8052-0f7da6e93ebc for instance 69f655b3-78d2-40f5-ac78-806952dba34b on hv-cinder-85427 Aug 29 22:41:55.220925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-c2c51593-810d-4f90-8f94-b1e1bc2ea449 req-de6bfec8-570f-40a8-afe2-c45bb159c78b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061732 Aug 29 22:41:55.222513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 86/168] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:55.498528 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.503003 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:55.519178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:55.520654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:55.521595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:55.522919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:55.524346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:55.524835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:55.782367 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.783653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:55.798517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:55.803023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:55.803866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:55.804665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:55.805143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:55.805568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:56.202037 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:56.220192 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3862bfe9-3059-4236-baba-29775d66dfa3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1558 microversion: 2.1 time: 0.729773 Aug 29 22:41:56.221289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 83/169] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1558 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:56.249384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:56.250072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:56.265696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:56.266629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:56.267271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:56.268660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:56.269287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:56.270355 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:56.451984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1938dc53-00e8-4e56-a398-eee4f296495e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207636 Aug 29 22:41:56.453322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 84/170] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:41:56 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:56.529009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:56.538035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fa97b5a0-8ca7-40f7-88d8-a928e58c810d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.761044 Aug 29 22:41:56.540178 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 87/171] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:57.562253 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.565043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:57.575794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:57.576601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:57.577426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:57.578347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:57.579302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:57.580199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:57.599230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.987005 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:57.997759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=98 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:58.006342 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:58.007147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:58.007730 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:58.024468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] Creating event network-changed:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:41:58.037318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-713579fb-ad15-46e4-b816-4d76f68e0505 req-f3356cbf-bccb-4496-b3d1-7cd9a729f3ae service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054530 Aug 29 22:41:58.038880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 88/172] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:41:58.048732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:58.058641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f5928e85-a341-4825-8c47-7a8adb067db0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1360 microversion: 2.1 time: 0.500367 Aug 29 22:41:58.059920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 85/173] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1360 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:59.082835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:59.083542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:59.104433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.104951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.105352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.107243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.107839 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.108420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.147601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:59.549131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:41:59.565287 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f225e101-42be-4db8-bc33-7c66d82cf147 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1545 microversion: 2.1 time: 0.485015 Aug 29 22:41:59.575444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 89/174] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:41:59 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1545 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:59.591257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:59.600644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:41:59.614953 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.616369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.617638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.619097 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.619802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.620570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.784195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-436827c3-a607-429e-99a0-d97d79a548fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198432 Aug 29 22:41:59.794296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 86/175] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:41:59 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:00.312295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48a61e3-953a-41a2-a47f-96f40b362e3e", "tag": "f190fef4-1aa0-400e-be49-90c39442815f"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:00.338995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:00.339615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:00.346123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:00.390761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] Creating event network-changed:f190fef4-1aa0-400e-be49-90c39442815f for instance e48a61e3-953a-41a2-a47f-96f40b362e3e on hv-cinder-85427 Aug 29 22:42:00.398030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-3fc1bc76-4461-4499-a9b6-fa4b64c4dd61 req-97e6849c-b283-4ced-8720-576f83bca6aa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089334 Aug 29 22:42:00.404832 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 90/176] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:02.482709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f655b3-78d2-40f5-ac78-806952dba34b", "tag": "62afccef-e8d2-4fce-8052-0f7da6e93ebc"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:02.497706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:02.498486 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:02.500419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:02.511129 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] Creating event network-changed:62afccef-e8d2-4fce-8052-0f7da6e93ebc for instance 69f655b3-78d2-40f5-ac78-806952dba34b on hv-cinder-85427 Aug 29 22:42:02.521621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-b15be5b2-86eb-4202-be84-862a3d5cd066 req-35104d81-896a-4406-a107-af655491ddd5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042857 Aug 29 22:42:02.522518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 87/177] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:02.880533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:02.881434 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:02.902249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:02.903714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:02.905185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:02.906169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:02.906918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:02.907560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:02.940842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:42:03.269670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c6eecea4-edf2-4037-a915-03307056f63c tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 204 len: 0 microversion: 2.1 time: 0.393582 Aug 29 22:42:03.271951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 91/178] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:42:02 2022] DELETE /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:42:03.281780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:03.282830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:03.299207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:03.299207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:03.303598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:03.304759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:03.308002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:03.308628 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:03.653096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:03.672068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2f756cc8-0e5a-42b7-9dd4-6a358456ea26 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1554 microversion: 2.1 time: 0.395319 Aug 29 22:42:03.691344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 88/179] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:03 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1554 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:04.701397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:04.703400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:04.712039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:04.712873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:04.713482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:04.714587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:04.715733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:04.716315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:04.976712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:04.991818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-afe5b56d-3358-4dea-aae0-a88c62dee94f tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1554 microversion: 2.1 time: 0.295051 Aug 29 22:42:04.996498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 92/180] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:04 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:06.027346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:06.030171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:06.044952 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:06.046131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:06.046924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:06.048290 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:06.055533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:06.056010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:06.073361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59", "name": "network-vif-deleted", "tag": "c3f0935d-657d-4918-a1cf-10cf49337110"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:06.087487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:06.087976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:06.088388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:06.103745 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] Creating event network-vif-deleted:c3f0935d-657d-4918-a1cf-10cf49337110 for instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 on hv-cinder-85427 Aug 29 22:42:06.110035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-4014954e-f633-4e04-9520-80cb2a04b4ca req-4ba415f0-6b9b-4ae4-866f-c93d33f9a3c9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041137 Aug 29 22:42:06.115303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 93/181] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:42:06.179718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:06.198137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7f67e30d-e47b-49fd-8258-49ac226e9834 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1512 microversion: 2.1 time: 0.182276 Aug 29 22:42:06.199814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 89/182] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:06 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:07.223474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:07.224297 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:07.231340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:07.231911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:07.232337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:07.233085 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:07.233484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:07.233901 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:07.280406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:07.280895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:07.281330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:07.281844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lazy-loading 'fault' on Instance uuid 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:42:07.329988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c45a0b5705455c8bb3f09053e325cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5cee4eb87f4428aa0c68502f2eaab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:07.339550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7be76d18-ec5a-4553-948e-a58dbb122876 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 200 len: 1350 microversion: 2.1 time: 0.121998 Aug 29 22:42:07.340725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 94/183] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:07 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:08.362745 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:08.363955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:08.373908 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:08.374404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:08.374866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:08.375580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:08.376033 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:08.376461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:08.403935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] HTTP exception thrown: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Request method failure captured: Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 HTTP/1.1 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUB3JkPbbuZUfgGJgRaXjmcCmvVICC_Tn3LA7cTA5IEnlxpXLLQf0wI9GcIo3aAvXPfbtLIgLGmaYQD7_JawYZ-3W4GFEN3vRp6K5gDFIn09RM9cN8Z-tHKXxTwdHc0QxMyDYmmU9TsEK79x7S2Y4I_2poODewJYWaWVgiS5GsgjCNw Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:42:08.410280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_5b5cee4eb87f4428aa0c68502f2eaab1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}] Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 72c45a0b5705455c8bb3f09053e325cf Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.411641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59'} Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:42:08.412431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.413607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.416525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Returning 404 to user: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:42:08.417609 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-dd63c197-ea87-4377-9eea-12465108a1da tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 404 len: 111 microversion: 2.1 time: 0.059865 Aug 29 22:42:08.418712 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 90/184] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:08 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:42:08.623178 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:08.625976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:08.635108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:08.635601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:08.636171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:08.637185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:08.637585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:08.638162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:08.652587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] HTTP exception thrown: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Request method failure captured: Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59/os-volume_attachments HTTP/1.1 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUB3JkPbbuZUfgGJgRaXjmcCmvVICC_Tn3LA7cTA5IEnlxpXLLQf0wI9GcIo3aAvXPfbtLIgLGmaYQD7_JawYZ-3W4GFEN3vRp6K5gDFIn09RM9cN8Z-tHKXxTwdHc0QxMyDYmmU9TsEK79x7S2Y4I_2poODewJYWaWVgiS5GsgjCNw Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:42:08.656856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_5b5cee4eb87f4428aa0c68502f2eaab1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}] Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 72c45a0b5705455c8bb3f09053e325cf Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.658281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'server_id': '5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59'} Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:42:08.658982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:08.660086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:08.661202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Returning 404 to user: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:42:08.661202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a7692a60-7150-414e-8061-c49a53d13c8e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040965 Aug 29 22:42:08.661202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 95/185] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:42:08 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:42:09.956302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:09.956750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:09.971411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:09.972244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:09.973000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:09.974557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:09.975399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:09.976416 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:09.998412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] HTTP exception thrown: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Request method failure captured: Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 HTTP/1.1 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUB3JkPbbuZUfgGJgRaXjmcCmvVICC_Tn3LA7cTA5IEnlxpXLLQf0wI9GcIo3aAvXPfbtLIgLGmaYQD7_JawYZ-3W4GFEN3vRp6K5gDFIn09RM9cN8Z-tHKXxTwdHc0QxMyDYmmU9TsEK79x7S2Y4I_2poODewJYWaWVgiS5GsgjCNw Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:42:10.001480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_5b5cee4eb87f4428aa0c68502f2eaab1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}] Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 72c45a0b5705455c8bb3f09053e325cf Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.002899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59'} Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:42:10.003731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.005184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.009480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Returning 404 to user: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:42:10.010356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4ef3dc58-c977-4d61-9422-80c8126560f9 tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 404 len: 111 microversion: 2.1 time: 0.065019 Aug 29 22:42:10.010949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 91/186] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:42:09 2022] DELETE /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:42:10.020149 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:10.021049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] [instance: 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:10.031364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:10.036469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:10.037277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:10.038535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:10.039412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:10.040427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:10.067367 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] HTTP exception thrown: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Request method failure captured: Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 HTTP/1.1 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUB3JkPbbuZUfgGJgRaXjmcCmvVICC_Tn3LA7cTA5IEnlxpXLLQf0wI9GcIo3aAvXPfbtLIgLGmaYQD7_JawYZ-3W4GFEN3vRp6K5gDFIn09RM9cN8Z-tHKXxTwdHc0QxMyDYmmU9TsEK79x7S2Y4I_2poODewJYWaWVgiS5GsgjCNw Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:42:10.071225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_5b5cee4eb87f4428aa0c68502f2eaab1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5b5cee4eb87f4428aa0c68502f2eaab1"}]}] Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 5b5cee4eb87f4428aa0c68502f2eaab1 Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304359646 Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 72c45a0b5705455c8bb3f09053e325cf Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-DeleteServersTestJSON-1304359646-project Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.072733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59'} Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:42:10.073525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. Aug 29 22:42:10.075389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:42:10.076528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] Returning 404 to user: Instance 5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:42:10.076528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5638fcb1-51b3-4391-9144-870b9b09d12e tempest-DeleteServersTestJSON-1304359646 tempest-DeleteServersTestJSON-1304359646-project] 10.222.0.77 "GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59" status: 404 len: 111 microversion: 2.1 time: 0.056799 Aug 29 22:42:10.076528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 96/187] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:10 2022] GET /compute/v2.1/servers/5d34e6f0-76d2-49c2-92c2-ffcaa6bdcb59 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:42:24.139522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=21 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:24.140824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=25 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:24.554517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-275694700", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:24.624625 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] validate_networks() for [('40dada36-2150-4300-9ee8-450a7585ae7c', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:42:25.210614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:42:25.212677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:42:25.213481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:42:25.213888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:42:25.214337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:42:25.224476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:25.224964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:25.225783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:25.232319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:25.233129 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:25.233768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:25.294397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:42:25.306517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for user 8b46b3fa1df24c80ab7315c4ff44c064 and project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:42:25.337259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:42:25.340950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:42:25.451652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e57964f6-6ee5-44dd-a57c-6faa5ae00030 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.317352 Aug 29 22:42:25.453239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 92/188] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:42:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:42:25.465453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9e7f3dac-0771-490f-b147-f8b54d4225bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:25.467676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9e7f3dac-0771-490f-b147-f8b54d4225bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:25.472849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:25.473933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:25.595174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9e7f3dac-0771-490f-b147-f8b54d4225bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:25.612673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9e7f3dac-0771-490f-b147-f8b54d4225bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1221 microversion: 2.1 time: 0.144025 Aug 29 22:42:25.613337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 97/189] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:25 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:25.876201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-830430180", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:25.977980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] validate_networks() for [('40dada36-2150-4300-9ee8-450a7585ae7c', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:42:26.708072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:42:26.711307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:42:26.712804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:42:26.713547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:42:26.714206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:42:26.733679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:26.736354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:26.737088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:26.738176 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:26.740445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:26.741110 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:26.773662 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:42:26.779871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for user 8b46b3fa1df24c80ab7315c4ff44c064 and project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:42:26.795556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:42:26.798989 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:42:26.877929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2988a586-400a-40a8-9a68-dd64dd89d9f2 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.017623 Aug 29 22:42:26.882141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 93/190] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:42:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:42:26.893671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-de510af0-ffe8-469f-8ff7-169fdb0fe826 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:26.897310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-de510af0-ffe8-469f-8ff7-169fdb0fe826 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:27.009404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-de510af0-ffe8-469f-8ff7-169fdb0fe826 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:27.027837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-de510af0-ffe8-469f-8ff7-169fdb0fe826 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1221 microversion: 2.1 time: 0.140202 Aug 29 22:42:27.028893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 98/191] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:26 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:28.058384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:28.069788 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:28.093300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:28.094891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:28.095349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:28.105350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:28.108017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:28.108469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:28.220475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:28.231309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3fd8d44b-2f70-410a-ae71-5f8c23511150 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1217 microversion: 2.1 time: 0.179747 Aug 29 22:42:28.232253 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 94/192] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:28 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:29.252439 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:29.253065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:29.267129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:29.267643 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:29.268081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:29.272465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:29.275814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:29.279441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:29.470330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:29.491076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-91448e90-cc40-40e3-a02e-16f47d4d756c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1279 microversion: 2.1 time: 0.242176 Aug 29 22:42:29.492198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 99/193] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:29 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:29.990625 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e78f6ed-61b5-43c7-acd0-82d594ac1a2a", "tag": "3ccec209-cbef-4789-bf99-1b161e07c449"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:30.007795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:30.011514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:30.012164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:30.034462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] Creating event network-changed:3ccec209-cbef-4789-bf99-1b161e07c449 for instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a on hv-cinder-85427 Aug 29 22:42:30.041045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-ffbf534e-26fd-4eee-80b2-57632708f44c req-7c4ecbdb-c0b1-494d-8cf3-e325c46ab65b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054116 Aug 29 22:42:30.041840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 95/194] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:30.514969 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:30.515798 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:30.531088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:30.531746 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:30.532190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:30.532904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:30.533554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:30.534057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:30.730448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:30.738334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6a2697e8-198e-4a9c-bbd8-54b9ae90050c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.227826 Aug 29 22:42:30.739245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 100/195] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:30 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:31.257413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc18feed-7dc2-459c-a709-7ac2d882f719", "tag": "be00f065-5f4e-4890-b580-124b491dda4a"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:31.268066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:31.268535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:31.268959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:31.280384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] Creating event network-changed:be00f065-5f4e-4890-b580-124b491dda4a for instance cc18feed-7dc2-459c-a709-7ac2d882f719 on hv-cinder-85427 Aug 29 22:42:31.285015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-636bcb22-4551-416f-94d9-07f38ca7e4ec req-15a544b5-8fc1-48f0-8796-8e3ffdb5b255 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Aug 29 22:42:31.285594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 96/196] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:31.760490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:31.762287 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:31.770957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:31.771977 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:31.772639 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:31.773609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:31.774464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:31.775212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:32.260205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:32.273448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-35fcb480-15a2-43ed-a2b5-a1a583fe53ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.517430 Aug 29 22:42:32.274777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 101/197] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:31 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:33.297398 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:33.298086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:33.304774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:33.305203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:33.305849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:33.306312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:33.306774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:33.307200 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:33.486695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:33.496164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-172c3397-f57d-4788-8dc1-a471beabf9ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.204929 Aug 29 22:42:33.497488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 97/198] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:33 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:34.520017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:34.521240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:34.529780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:34.530559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:34.531192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:34.532131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:34.532696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:34.533230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:34.702339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:34.724644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a5309a8c-dee7-43bf-993c-c3b727ae2a84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.208525 Aug 29 22:42:34.725808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 102/199] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:34 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:34.877143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e78f6ed-61b5-43c7-acd0-82d594ac1a2a", "name": "network-vif-plugged", "status": "completed", "tag": "3ccec209-cbef-4789-bf99-1b161e07c449"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:34.887223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:34.888009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:34.888648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:34.909662 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] Creating event network-vif-plugged:3ccec209-cbef-4789-bf99-1b161e07c449 for instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a on hv-cinder-85427 Aug 29 22:42:34.915560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-e966def9-ba0e-40b9-90a6-48b2fb31fa22 req-445540e3-d5b7-4c41-a829-6e816e96de7b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042322 Aug 29 22:42:34.917721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 98/200] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:35.287705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:35.288322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:35.296464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:35.297190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:35.297653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:35.298335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:35.298827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:35.299244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:35.325466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d7a53122-530d-49f8-b19e-71c00a0bde53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/ips" status: 200 len: 151 microversion: 2.20 time: 0.041937 Aug 29 22:42:35.326583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 103/201] 10.222.0.77 () {60 vars in 1289 bytes} [Mon Aug 29 22:42:35 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:42:35.755423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:35.756210 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:35.763629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:35.764209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:35.764719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:35.765522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:35.766178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:35.766706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:35.941488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:35.952776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ef9f0d8d-c910-4a32-9442-52ba22666cb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.203302 Aug 29 22:42:35.953600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 99/202] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:35 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:36.938034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc18feed-7dc2-459c-a709-7ac2d882f719", "name": "network-vif-plugged", "status": "completed", "tag": "be00f065-5f4e-4890-b580-124b491dda4a"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:36.948423 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:36.948911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:36.949557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:36.971259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] Creating event network-vif-plugged:be00f065-5f4e-4890-b580-124b491dda4a for instance cc18feed-7dc2-459c-a709-7ac2d882f719 on hv-cinder-85427 Aug 29 22:42:36.976587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-676b5266-854e-42c2-bda3-888ba8729b8c req-1c0967ae-5700-4f11-81c8-3dcfdf5b75bb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042758 Aug 29 22:42:36.977438 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 104/203] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:36.980807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:36.981768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:36.987133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:36.988353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=12 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:36.992693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:36.993915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:36.994627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:36.996025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:36.996817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:36.997734 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:37.137130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:37.146415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a5aafe15-6afe-45b5-b583-4306283b26b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.175444 Aug 29 22:42:37.147024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 100/204] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:36 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:38.167088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:38.173668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:38.174631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:38.184800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:38.185603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:38.186311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:38.187492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:38.188235 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:38.188948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:38.351677 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:38.367078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d3c17707-1dc9-407d-ba77-237180607566 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.201257 Aug 29 22:42:38.367675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 105/205] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:38 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:38.834320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:38.835128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:38.842539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:38.843040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:38.843474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:38.845004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:38.845467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:38.845888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:38.871706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'flavor' on Instance uuid 85dd30e7-c635-4bcd-98e3-8aa61c52d30e {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:42:39.388996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:39.389630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:39.396625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:39.397112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:39.397636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:39.398400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:39.399029 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:39.399550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:39.536673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:39.546116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c4cd34b2-0585-4d15-9754-39f2a615e77a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1321 microversion: 2.1 time: 0.160825 Aug 29 22:42:39.546711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 106/206] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:39 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:40.569474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:40.569474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:40.576684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.577101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.577539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:40.578309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.579381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.579804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:40.739544 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:40.752815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-bbf0505c-1612-4a88-9c8b-30a014053098 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1514 microversion: 2.1 time: 0.188886 Aug 29 22:42:40.754772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 107/207] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:40 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:40.776802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:40.780296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:40.791841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.792342 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.792782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:40.793493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.794158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.794630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:40.829995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lazy-loading 'flavor' on Instance uuid cc18feed-7dc2-459c-a709-7ac2d882f719 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:42:40.955150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c05fd971-fb8f-4186-9067-b715f7810023 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719/action" status: 200 len: 32 microversion: 2.1 time: 0.185204 Aug 29 22:42:40.956192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 108/208] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:42:40 2022] POST /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:42:40.965741 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:40.966668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:40.974614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.975435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.975870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:40.976575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:40.977332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:40.977465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:41.256408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:41.270672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-12e35c27-dde8-4990-a75b-d901e7bfaa86 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.308911 Aug 29 22:42:41.271965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 109/209] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:40 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:41.324052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:41.324542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:41.333035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:41.334058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:41.335077 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:41.336342 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:41.337192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:41.337986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:41.372448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7021035e-dcad-4ca2-879c-514683ab4ef7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/ips" status: 200 len: 150 microversion: 2.1 time: 0.052807 Aug 29 22:42:41.373289 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 110/210] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:42:41 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:42:42.298758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:42.300759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:42.309950 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:42.310750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:42.311420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:42.312878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:42.313921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:42.314934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:42.513380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:42.521101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1dd60652-6805-4832-b902-b86871f08600 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.229629 Aug 29 22:42:42.521760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 111/211] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:42 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:42.882906 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "109897a1-6d0a-43f5-82a0-0cfa18eb5bbb"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:42.887192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:42.895942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:42.896740 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:42.897400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:42.898559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:42.899253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:42.899893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:43.190168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-46ea81d2-0745-4ebd-bffc-0ce5d1229b50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312333 Aug 29 22:42:43.191116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 112/212] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:42:42 2022] POST /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:42:43.547091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:43.547713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:43.554664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:43.555270 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:43.555705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:43.556396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:43.556956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:43.558030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:43.578045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:43.704860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:43.713129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-544ac392-af8b-42b1-83d3-1ea5c08bd714 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.171728 Aug 29 22:42:43.713913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 113/213] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:43 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:43.967145 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:43.967649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:43.975426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:43.975916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:43.976356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:43.977063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:43.979650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:43.979650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:44.007080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-07ced2a6-5b6d-4136-bd4d-d5e4307d3b0b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/ips" status: 200 len: 145 microversion: 2.1 time: 0.044053 Aug 29 22:42:44.014010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 114/214] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:42:43 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:42:44.078587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1460525676", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "networks": [{"uuid": "231f0f42-8ad1-4fa2-99bc-8a96caeeee6e"}]}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:45.618244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-531613d7-9196-4e2b-9221-0fbc7e60d592 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/action" status: 202 len: 0 microversion: 2.20 time: 6.788285 Aug 29 22:42:45.624259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] validate_networks() for [('231f0f42-8ad1-4fa2-99bc-8a96caeeee6e', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:42:45.639095 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 101/215] 10.222.0.77 () {62 vars in 1319 bytes} [Mon Aug 29 22:42:38 2022] POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/action => generated 0 bytes in 6809 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:42:45.651083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:45.651697 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:45.659657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:45.660148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:45.661505 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:45.662228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:45.662691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:45.663149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:45.877990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:45.886505 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d8e37e9e-6596-4c50-b27e-f8c318567f2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.244668 Aug 29 22:42:45.887109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 102/216] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:45 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:45.891950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:45.892542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:45.898277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:45.898772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:45.899286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:45.899967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:45.900411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:45.901457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.129295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:46.138515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:46.140186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:46.141443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5cd38df2-9603-4b4d-897a-51a0dc177ce3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.253206 Aug 29 22:42:46.142812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 103/217] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:45 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:46.182868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:42:46.183311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:42:46.183805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:42:46.184191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:42:46.184628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:42:46.193542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.194026 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.194459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.195216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.195671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.196095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.212773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Getting quotas for project 211213d0c20641adb48a3d39703f7532. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:42:46.217420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Getting quotas for user 2d0e45a9ee9644f8b9eac57d9a14d14e and project 211213d0c20641adb48a3d39703f7532. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:42:46.229055 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:42:46.231349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:42:46.282641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f61518c3-1023-45f7-af3f-e2fc78c32624 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208090 Aug 29 22:42:46.283432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 115/218] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:42:46.295847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-44e4dc51-881d-45d2-835e-763170be133b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:46.296472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-44e4dc51-881d-45d2-835e-763170be133b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:46.352500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-44e4dc51-881d-45d2-835e-763170be133b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:46.359823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-44e4dc51-881d-45d2-835e-763170be133b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1219 microversion: 2.1 time: 0.068782 Aug 29 22:42:46.360397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 104/219] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:46 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:46.771738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3a2d59-7960-4447-a518-6e33731503a3"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:46.774216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:46.781676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.782223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.782703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.783359 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.783800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.784221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.908505 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:46.909122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:46.915448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.915980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.916947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:46.917645 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:46.918093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:46.918517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:47.080415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:47.090022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9e4a215e-0ab0-402a-92db-9c543636a7af tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.185622 Aug 29 22:42:47.090323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ec439c4e-1521-450c-b0d2-fe229291e60b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323083 Aug 29 22:42:47.090706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 105/220] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:46 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:47.090956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 116/221] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:42:46 2022] POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:47.165550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:47.166152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:47.173614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:47.174093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:47.174542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:47.175242 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:47.175851 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:47.176269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:47.310423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:47.318489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:47.319945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:47.321090 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5a596310-9e53-4ec2-b5ea-4b0c7ddb4272 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.159402 Aug 29 22:42:47.321644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 106/222] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:47 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:47.381561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:47.382274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:47.390650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:47.391083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:47.391526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:47.392196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:47.392644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:47.393053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:47.469268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:47.479924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ed77196d-7184-41da-ae0f-2c4e80c40657 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1271 microversion: 2.1 time: 0.103037 Aug 29 22:42:47.481075 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 117/223] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:47 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:48.113146 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:48.113759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:48.120561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.121045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.121487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.122179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.122687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.123084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.331609 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:48.342108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5fd5f3b5-13c3-41a4-926f-fa8faadd2953 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.232718 Aug 29 22:42:48.344441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:48.346229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:48.352850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.353337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.353791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.354656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.355162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.355587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.355720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 107/224] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:48 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:48.501700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:48.502412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:48.508461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.508938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.509372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.510659 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:48.511208 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:48.511633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:48.604945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:48.615249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:48.616702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:48.617888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2a2eb2c7-ead7-43f1-b6f6-be25d5f9aa82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.277997 Aug 29 22:42:48.618456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 118/225] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:48 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:42:48.992120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:49.000430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7c45859f-15b7-4c45-a95c-fce10d6fb35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.502773 Aug 29 22:42:49.001139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 108/226] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:48 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:49.371294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:49.372354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:49.381418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:49.382103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:49.382947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:49.383849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:49.384454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:49.385820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:49.395839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfb8e85-df7b-4481-9900-647fadc1bd32", "tag": "626598b1-3252-4a55-a7ba-a75d9650dc20"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:49.414597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:49.415469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:49.418372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:49.435575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] Creating event network-changed:626598b1-3252-4a55-a7ba-a75d9650dc20 for instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 on hv-cinder-85427 Aug 29 22:42:49.440745 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-1d16ddef-bffd-429c-b463-ef639b086b2b req-079cb1ef-433a-43e9-859a-2df36141da04 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048698 Aug 29 22:42:49.441514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 109/227] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:49.561507 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:49.569813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5a2f1f25-e339-4093-ae9d-82ed375beeca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.207663 Aug 29 22:42:49.570402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 119/228] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:49 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:49.645721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:49.646405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:49.652707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:49.653179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:49.653605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:49.654295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:49.654756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:49.655180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:49.906494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:49.916861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:49.918314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:49.919498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6af25381-c9c1-49f9-aef6-3c44adec4078 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.278011 Aug 29 22:42:49.920064 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 110/229] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:49 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:50.024916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:50.026304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:50.033710 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.034343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.035128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:50.035872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.036339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.036780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:50.333492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:50.343190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-87d30d31-7e05-499a-bdd2-485e21c5fc76 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.323102 Aug 29 22:42:50.344380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 120/230] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:50 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:50.592062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:50.592806 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:50.600853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.601418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.601856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:50.602585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.603066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.603489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:50.622617 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:50.747206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:50.757991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8c304ba9-cced-4a98-a89f-15945c192835 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.169967 Aug 29 22:42:50.758567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 111/231] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:50 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:50.817829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2150af95-120d-48a9-93dd-8576ffc02fca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: .version_select at 0x7f5cf6e048b0>, body: {"keypair": {"name": "tempest-keypair-1605846232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh07tjsBFQ07w6rvDDd3hw3X5FOr4syMM9MwhdEzWVJHLfKvtYWqOuY71MqEpAbkybB53IAHI+uLSPtdMo2X9gGoNGZPSFAt8DW94bKg5lZ1So+S22z+krYLQoBOeouyQ=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:50.833443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-2150af95-120d-48a9-93dd-8576ffc02fca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:42:50.837095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-2150af95-120d-48a9-93dd-8576ffc02fca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:42:50.858805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2150af95-120d-48a9-93dd-8576ffc02fca tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044731 Aug 29 22:42:50.859438 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 121/232] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:42:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:50.943736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:50.944626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:50.951034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.951548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.951985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:50.952704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:50.953158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:50.953583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:51.107689 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:51.115853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:51.117546 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:51.118609 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9adbb0b2-1545-4d37-999c-191bf2f609fc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.179491 Aug 29 22:42:51.119214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 112/233] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:50 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:51.364879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:51.365549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:51.372072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:51.374145 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:51.374620 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:51.375526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:51.375985 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:51.376412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:51.674744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:51.688241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-85ccc41d-ae60-4684-ae47-0f453bd8f722 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.327436 Aug 29 22:42:51.690099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 122/234] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:51 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:51.779943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:51.780733 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:51.790581 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:51.791097 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:51.792450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:51.793734 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:51.794492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:51.795269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:51.967926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:51.982528 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2da3e1ea-aa8e-463d-9d22-29492ec9436c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.206698 Aug 29 22:42:51.983153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 113/235] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:51 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:52.144377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:52.145090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:52.153650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:52.164785 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:52.165606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:52.166446 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:52.166951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:52.168019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:52.346479 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:52.357115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:52.358838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:52.360265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c293df0a-1c52-4f9a-b9ec-8e700ef5e291 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.221058 Aug 29 22:42:52.360832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-984677805", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4fab7c6-be28-40e9-82ea-67b0ac291d9e"}], "security_groups": [{"name": "tempest-securitygroup--1747841790"}], "key_name": "tempest-keypair-1605846232", "user_data": "}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:52.367621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 123/236] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:52 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:52.521301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] validate_networks() for [('c4fab7c6-be28-40e9-82ea-67b0ac291d9e', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:42:52.710120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:52.710837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:52.718064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:52.718837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:52.719544 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:52.720253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:52.720709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:52.721136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:52.992221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.000671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0476a149-0c12-47b4-a0d7-185d045f7986 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.294664 Aug 29 22:42:53.001224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 124/237] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:52 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:53.020800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:53.021404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:53.027486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.027970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.028398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.029087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.029531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.030133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.187407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:42:53.187904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:42:53.188285 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:42:53.188692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:42:53.189144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:42:53.198604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.199113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.199550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.200288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.200741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.201167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.218279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.219211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:42:53.228345 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7b71c17c-e06f-4b93-b244-fda24ab07aae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.211256 Aug 29 22:42:53.228590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:42:53.229519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 125/238] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:53 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:53.241224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:42:53.243554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:42:53.293619 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-416d9944-ff2b-4b11-9f1d-44cefcf9a5fa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.937133 Aug 29 22:42:53.294268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 114/239] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:42:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:42:53.304997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1f331e9a-dff8-4693-96d5-412f45f687c8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:53.305620 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1f331e9a-dff8-4693-96d5-412f45f687c8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:53.372125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1f331e9a-dff8-4693-96d5-412f45f687c8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.385805 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:53.385805 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:53.386081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1f331e9a-dff8-4693-96d5-412f45f687c8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1241 microversion: 2.1 time: 0.082631 Aug 29 22:42:53.386081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 126/240] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:53 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:42:53.390123 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.390602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.391053 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.391745 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.392190 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.392658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.530564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.539556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.545747 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.545747 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d4217ec2-9fc3-4a04-a2a2-014de491e055 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.163997 Aug 29 22:42:53.559814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 115/241] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:53 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:53.671776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:53.677718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.678207 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.678662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.743929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Going to try to stop instance {{(pid=148457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:42:53.788291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6efa437c-ac3b-4de1-85ce-58943da643f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action" status: 202 len: 0 microversion: 2.1 time: 0.120300 Aug 29 22:42:53.788896 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 127/242] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:42:53 2022] POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:42:53.797444 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:53.798054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:53.804231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.804706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.805136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.805823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:53.806270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:53.806695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:53.938842 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:53.947234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1ff5e16f-3104-449f-b7d6-a0525f3f35e7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.153689 Aug 29 22:42:53.947827 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 116/243] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:53 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:54.023498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:54.024091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:54.031034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.031528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.031968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.032673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.033135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.033564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.167325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.174947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4fa3ae39-c9f0-44ba-b31c-01d1353856ed tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.155881 Aug 29 22:42:54.175505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 128/244] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:54 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:54.250018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:54.250664 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:54.252430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:54.257653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.258125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.258754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.259471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.260487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.260919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.391292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.398840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-65d18d30-08bd-4b07-92a7-0731a4353696 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.152631 Aug 29 22:42:54.399405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 117/245] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:54 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:54.411486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:54.412400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:54.420486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.421783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.421783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.424023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.424023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.424023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.487631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.495691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-08fa06c7-02b7-4c61-aa32-e16350380a7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1245 microversion: 2.1 time: 0.089275 Aug 29 22:42:54.496253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 129/246] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:54 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:54.570233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:54.570763 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:54.577193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.577678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.578115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.578902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.579394 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.579990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.710019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.719205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.720649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:54.721815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4b700cf3-76be-4181-ab1f-831846de79be tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.158748 Aug 29 22:42:54.722375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 118/247] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:54 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:54.968864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:54.969779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:54.975885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.976343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.976770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:54.977456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:54.977905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:54.978328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.114720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.118948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:55.126512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-294bcbe4-595f-4cef-bf81-2742b64c948e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.161433 Aug 29 22:42:55.127356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 130/248] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:54 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:55.196475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:55.197107 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:55.204519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.205031 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.205491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.206201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.206678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.207157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.386304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.394322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-770a1d0d-99e2-4e55-841b-abfe60444119 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.201699 Aug 29 22:42:55.394922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 119/249] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:55 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:55.420465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:55.421080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:55.425124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:55.429925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.430421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.434324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.434324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.434324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.434324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.516927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:55.517504 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:55.523589 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.524072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.524497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.525191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.525668 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.526083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.585193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.594491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-55075cd3-35b6-4b1d-ad51-32819eece820 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.177908 Aug 29 22:42:55.595111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 131/250] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:55 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:55.601484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.609470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1f21518d-48ac-4f1e-8557-ca8811414254 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1245 microversion: 2.1 time: 0.096371 Aug 29 22:42:55.610050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 120/251] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:55 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:55.745521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:55.746132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:55.754944 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.755436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.755872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.756571 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:55.757028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:55.757452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:55.922226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.930533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.932841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:55.934022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0a3a945b-2b17-4056-b804-9d6b2a4517c3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.192902 Aug 29 22:42:55.934593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 132/252] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:55 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:56.148787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:56.149387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:56.155579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.156049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.156477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.157291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.157738 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.158164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.346388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:56.356295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2cdbe160-fbb5-4896-a8ea-d845e5327e7b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.211313 Aug 29 22:42:56.356845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 121/253] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:56 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:56.419848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:56.420632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:56.424349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:56.432173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.432970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.433656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.434822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.435589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.436300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.615592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:56.616898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:56.625557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.625557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.625557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.626000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.626641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.627255 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.686542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:56.699489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5015354d-b44e-4862-b0d5-a60aaef323b5 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.287455 Aug 29 22:42:56.700933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 133/254] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:56 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:56.705747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:56.708197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:56.715302 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.715912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.716405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.717279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.717761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.718256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.822182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:56.829618 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9eaa9dd2-b230-4418-94b9-6cd0831d4af7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1293 microversion: 2.1 time: 0.127418 Aug 29 22:42:56.830212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 134/255] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:56 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:56.957952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:56.958579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:56.965600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.966108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.966671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:56.967431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:56.967893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:56.968327 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.147136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.155799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-dba691e4-4cf9-4c78-a4c5-ada95a4e3ed1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.543948 Aug 29 22:42:57.156377 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 122/256] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:56 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:57.331929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.342230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.344542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.347010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6115869c-9a6e-4d13-9b65-197c245889b5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.393088 Aug 29 22:42:57.362827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 135/257] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:56 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:42:57.380655 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:57.381439 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:57.390833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.392092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.392654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.393480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.394227 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.394868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.564526 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.573084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8425b21c-c067-4fe9-8775-28a299e9322c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.198062 Aug 29 22:42:57.573646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 123/258] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:57 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:57.721324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:57.721912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:57.729418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.729912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.730348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.731090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.731657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.731962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.851075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:57.852441 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:57.863469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.864377 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.864814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.866063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:57.866515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:57.866970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:57.896181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.910163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0c532107-8ed4-4fcb-a8a9-80bbc7fe554b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.193228 Aug 29 22:42:57.911468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 136/259] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:57 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:57.949768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:57.959200 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1b09cf9b-845f-471b-b373-53b1becef54f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1299 microversion: 2.1 time: 0.112034 Aug 29 22:42:57.959772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 124/260] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:57 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:58.184296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:58.185439 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:58.200527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.201032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.201724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.204521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.207688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.208144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.358925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:58.366869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-231f4aa8-f855-4235-a281-e5cf90ae65fe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.193266 Aug 29 22:42:58.367442 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 137/261] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:58 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:58.382257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:58.383449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:58.390390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.390949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.391346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.392059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.392510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.392937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.572927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:58.583431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:58.590063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:58.591949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-06c6d7a6-7359-45ee-8e8b-819cfab530db tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.213437 Aug 29 22:42:58.592819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 125/262] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:58 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:58.594495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:58.595087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:58.602712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.603945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.604619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.606532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.607336 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.607934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.715925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb8e85-df7b-4481-9900-647fadc1bd32", "name": "network-vif-plugged", "status": "completed", "tag": "626598b1-3252-4a55-a7ba-a75d9650dc20"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:58.742123 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.742874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.744247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.770312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] Creating event network-vif-plugged:626598b1-3252-4a55-a7ba-a75d9650dc20 for instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 on hv-cinder-85427 Aug 29 22:42:58.782419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-0ace3e29-3aed-4b6f-9294-d4f53502fc36 req-4866b68e-630c-4a78-88aa-6dc5c0d8499f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077381 Aug 29 22:42:58.783068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 126/263] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:58.854721 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:58.867762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c22b7f24-baee-4b1f-9dec-2b315618a5fd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.277253 Aug 29 22:42:58.868758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 138/264] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:58 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:58.933892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:58.935348 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:58.944568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.952992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.953710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:58.954628 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:58.955736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:58.956471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.004265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:59.005524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:59.022866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.023468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.024659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.025177 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.026492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.027375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.261977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.269700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-452935ed-c5e4-4157-be5f-7e7203f3601e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.340486 Aug 29 22:42:59.270287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 127/265] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:58 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:59.286317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.296828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d793f140-1946-4f97-9e4a-af6f3e4cc483 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.318243 Aug 29 22:42:59.297572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 139/266] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:58 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:59.388880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:59.389490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:59.403533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.404132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.404611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.405555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.406196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.406500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.553758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.561922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3d649a23-f488-4255-84cf-12de4bf9b7cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.177624 Aug 29 22:42:59.562608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 128/267] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:59 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:42:59.622751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:59.623847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:59.636833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.637679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.639532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.641257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.642071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.643230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.679474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd5423a-56bc-4eb2-8285-f32a236db67a", "tag": "0aadfb69-64b9-4ed9-97ea-a90576f04ace"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:59.690833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.691469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.691997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.729047 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] Creating event network-changed:0aadfb69-64b9-4ed9-97ea-a90576f04ace for instance 5dd5423a-56bc-4eb2-8285-f32a236db67a on hv-cinder-85427 Aug 29 22:42:59.735695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-4414d538-aa62-48e7-85f1-de83501576ff req-0319f218-51ad-476f-9866-eab3d067adbe service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059890 Aug 29 22:42:59.736900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 129/268] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:59.820350 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.836264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.839766 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:42:59.841997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d49df734-a7c3-40fb-8c6c-815360eb4b5e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.225424 Aug 29 22:42:59.848227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 140/269] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:42:59 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:42:59.889902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:59.890594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:42:59.898140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.898829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.899263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.899955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:42:59.900993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:42:59.901419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:42:59.905991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:00.047371 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:00.058522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6d5e7ad9-e7ef-4e0f-bc72-31ff74e927f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.172561 Aug 29 22:43:00.060092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 130/270] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:42:59 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:00.300024 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:00.300658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:00.307835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.308325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.308764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.309491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.309949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.310377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.318469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:00.319133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:00.332867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.333575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.334101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.335077 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.336521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.341413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.537880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:00.546810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-22f0d68c-e536-41f4-b13a-a9910ef37a3b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1319 microversion: 2.1 time: 0.250829 Aug 29 22:43:00.547527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 141/271] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:00.573308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:00.582892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c3bcbe69-00b1-4996-aa7d-edd1222c9af4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.268393 Aug 29 22:43:00.583602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 131/272] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:00.586211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:00.587240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:00.595705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.596558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.597050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.597769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.598221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.598640 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.753614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:00.762073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b2910c83-26ee-4d4a-bc67-90bb169e99cb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.180995 Aug 29 22:43:00.762664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 142/273] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:00.873723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:00.874555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:00.880768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.881248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.881760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:00.882449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:00.883061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:00.883496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.020182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.029104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.030596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.031793 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9cf708e6-e0f6-4e14-8183-877a28ae3a84 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.162127 Aug 29 22:43:01.032351 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 132/274] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:01.081520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.082416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:01.090008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.090528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.092048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.093661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.094290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.094993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.264804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.273135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c72c4b5c-d6e5-43f5-95f8-25e9b6c64287 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.195885 Aug 29 22:43:01.273712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 143/275] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.576103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.577601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:01.589553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.590974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.591972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.594178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.595118 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.596705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.611072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.615694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:01.627444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.628051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.628566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.629349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.629880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.630376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.882839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.885940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:01.895308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cfc77b97-15a7-42be-87fd-2331cfe792c2 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1509 microversion: 2.1 time: 0.327031 Aug 29 22:43:01.896420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 133/276] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.897802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-69ca8703-60f0-4f60-b5ee-f8846416af88 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.294973 Aug 29 22:43:01.906511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.908534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:01.911315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 144/277] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.921021 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.922048 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.923310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:01.924758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:01.925594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:01.926100 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.057841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:02.058612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:02.067734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.068519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.069052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.070971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.070971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.070971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.126691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:02.136698 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ed805801-e723-47df-a16a-dfcef7871bee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.238703 Aug 29 22:43:02.137373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 134/278] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:02.233961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:02.244742 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:02.246304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:02.247740 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3e7de4c3-168c-473c-8a77-a0660a5ee239 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.195310 Aug 29 22:43:02.248312 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 145/279] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:02 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:02.298226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:02.298518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:02.309781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.310641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.311518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.312678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.313457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.314238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.509555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:02.520372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9f90d55f-eea2-4cb8-b88d-b0f2cd3952ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.228189 Aug 29 22:43:02.520969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 135/280] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:02 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:02.934173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:02.934764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:02.941469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.941961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.942401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:02.943167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:02.943626 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:02.944054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.080807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.088891 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7cec4535-ddeb-4579-977e-de913dcabcf3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.159512 Aug 29 22:43:03.089469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 146/281] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:02 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:03.162599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:03.163256 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:03.169365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.169854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.170286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.171019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.171477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.171904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.214289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:03.237155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=8 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:03.272658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:03.273495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:03.282759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.283515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.284246 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.285545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.286274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.286935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.308597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:03.329271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.337390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d11686ff-06d9-45b0-86ae-bb5713ca73ca tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.178607 Aug 29 22:43:03.338000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 136/282] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:03 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:03.376668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=12 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:03.434362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.444616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.446173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.447413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a740fe25-f3d0-4c57-ad34-73b672d8e5d7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.179258 Aug 29 22:43:03.447974 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 147/283] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:03 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:03.543598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:03.544210 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:03.550096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.550579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.551060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.551756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:03.552209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:03.552640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:03.692108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:03.705257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-31a7be2b-8e60-4277-8b8e-c0945a18071b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.165986 Aug 29 22:43:03.706085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 137/284] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:03 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:04.110535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:04.111127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:04.117762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.118243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.118676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.119401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.119848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.120264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.249139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.256814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-392272d4-45c3-4a48-83a9-25961e842c7d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.151015 Aug 29 22:43:04.257378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 148/285] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:04 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:04.358939 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:04.359714 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:04.365729 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.366150 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.366583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.367319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.367850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.368308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.470510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:04.471133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:04.477492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.477987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.478484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.479318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.479778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.480207 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.503138 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.511991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7540064d-3fa5-4435-b98a-00b764b1e527 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.156980 Aug 29 22:43:04.512559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 138/286] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:04 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:04.613118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.621750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.623494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.624300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cc1aa658-97b8-4c2f-90f6-9d54e4d4c2da tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.157969 Aug 29 22:43:04.624856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 149/287] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:04 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:04.733496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:04.734142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:04.740289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.740635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.741065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.741755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.742211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.742635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.872302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:04.880438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a38163a4-f61d-4f51-bb17-5e7d2727605c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.150908 Aug 29 22:43:04.881012 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 139/288] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:04 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:05.277703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:05.278332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:05.285236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.285738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.286184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.287138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.287664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.288097 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.421582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:05.429962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b475c57d-8ec4-4507-8e86-47e3a9b11166 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.156535 Aug 29 22:43:05.430541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 150/289] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:05 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:05.533135 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:05.533812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:05.542972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.543507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.544111 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.545315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.545567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.546025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.654286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:05.657025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:05.663374 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.664146 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.664307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.665019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.665474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.665932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.680959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:05.689651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-661ba95d-28b4-416f-9137-8844e1675e78 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.160482 Aug 29 22:43:05.690264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 140/290] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:05 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:05.800171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:05.808102 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:05.809779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:05.811389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-bfd561c9-f458-4586-8558-7024d0580039 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.162390 Aug 29 22:43:05.811960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 151/291] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:05 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:05.901364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:05.901969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:05.907932 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.908410 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.908847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:05.909562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:05.910044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:05.910496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.076251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:06.085732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b1674380-b2a8-4bcd-8ffd-8e16149bd4df tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.188483 Aug 29 22:43:06.086429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 141/292] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:05 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:06.452733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:06.453500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:06.461056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.461761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.462429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.463478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.464010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.464517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.717564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:06.721465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:06.724738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:06.733646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b7d4cf82-f6f7-41a8-ae85-8490600eea96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.286754 Aug 29 22:43:06.734233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 152/293] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:06 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:06.740313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.753365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.754178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.755502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.756359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.757141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.838234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:06.838234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:06.852886 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.854531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.855063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:06.855843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:06.856372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:06.856870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:07.069905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.089890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-61ec9941-be2d-4fea-a0ac-aa18ef466095 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.382230 Aug 29 22:43:07.097277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 142/294] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:06 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:07.109815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:07.113479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:07.120708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:07.121431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:07.122082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:07.122815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:07.123833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:07.124438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:07.127666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.137911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.139493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.141105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-40fc24fb-c047-4570-b2c4-562b8708afa8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1743 microversion: 2.20 time: 0.309200 Aug 29 22:43:07.141694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 153/295] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:06 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1743 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:07.270282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.280139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ff94c12c-99f0-4524-9717-3c8af34deb5e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.175836 Aug 29 22:43:07.280735 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 143/296] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:07 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:07.757679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:07.757679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:07.763049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:07.763556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:07.763989 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:07.764695 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:07.765153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:07.765584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:07.931936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:07.941018 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-086fab20-4e3a-4cba-94c0-d627f8b110ac tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.189153 Aug 29 22:43:07.947503 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 154/297] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:07 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:08.116809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:08.118044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:08.134317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.135965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.137013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.138500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.139631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.140385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.165551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:08.166305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:08.176447 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.178013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.178553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.179539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.180006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.180632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.352158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:08.360947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-89947e9f-918e-4dd9-bae0-41a34d59a127 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.251098 Aug 29 22:43:08.361518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 144/298] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:08 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:08.366359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:08.367268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:08.373902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.374767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.375311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.376260 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.376786 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.377281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.390106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:08.400437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:08.402460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:08.403697 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ec476c02-38dd-4e2c-8332-005b0bfcf6ac tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1743 microversion: 2.20 time: 0.242212 Aug 29 22:43:08.404262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 155/299] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:08 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1743 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:08.536521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:08.545548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ff655cf5-a66e-4fa0-92eb-bde1f709e5a7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.182819 Aug 29 22:43:08.546140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 145/300] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:08 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:08.874047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "name": "network-vif-plugged", "status": "completed", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:08.895535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.896017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.896626 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.911663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] Creating event network-vif-plugged:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:43:08.918483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-e4d745d9-699b-4c51-8f7b-79df0a7f4c3d req-34ab2abf-0c8d-4c39-a488-325876b5ab9c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057098 Aug 29 22:43:08.919794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 156/301] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:08.965558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:08.966175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:08.972587 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.973487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.973917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:08.974619 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:08.975099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:08.975516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.178809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:09.191168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:09.196574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-95e251dc-56ae-414b-a712-fc63b87c2d47 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.235510 Aug 29 22:43:09.200958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 146/302] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:08 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:09.390850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:09.392739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:09.407932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.410199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.412957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.414871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.416515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.417647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.438408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:09.443899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:09.471475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.478719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.480079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.481367 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.482152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.482934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.836424 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:09.858703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d42d6b71-8d9c-48eb-b343-d037e4e52ac7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.476922 Aug 29 22:43:09.863925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 157/303] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:09 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:09.873986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:09.875522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:09.889222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.890128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:09.890713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.893299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.896475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:09.897559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:09.899546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:09.901780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:09.903371 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:09.905041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-836d468f-8a8b-4bc0-8e23-1968ecf87882 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.480650 Aug 29 22:43:09.922851 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 147/304] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:09 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:10.138379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:10.157234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c4ecda17-6111-4142-8771-071113174d21 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.290982 Aug 29 22:43:10.159872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 158/305] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:09 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:10.237922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:10.239230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:10.246848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.247455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.247898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:10.249034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.249382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.249685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:10.460182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:10.472485 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-72c15ef5-51fb-42bd-b936-95c1bb069b5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.238928 Aug 29 22:43:10.474522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 148/306] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:10 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:10.887140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:10.888965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:10.896354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.897540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.898316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:10.899445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.900401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.900913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:10.952637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:10.953547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:10.960887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.961750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.962499 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:10.964030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:10.964707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:10.965387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:11.160050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.182592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dc074b40-8d66-4ae0-9929-14ec8a5eb10b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.301061 Aug 29 22:43:11.185395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 159/307] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:10 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:11.206456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:11.207399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:11.214447 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:11.215360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:11.215962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:11.216876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:11.217643 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:11.218227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:11.221432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.230877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.233007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.234299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f925f3b3-6509-4973-b9ee-829c17b60cb7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.285613 Aug 29 22:43:11.251877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 149/308] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:10 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:11.439893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.452133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cf3b5d2c-d861-43ec-9d60-f10cdc24f85f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.265082 Aug 29 22:43:11.453731 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 160/309] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:11 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:11.510886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:11.510886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:11.517515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:11.517515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:11.517515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:11.517515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:11.518679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:11.518679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:11.736742 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:11.761559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-86d78e4b-d8d2-4e45-ba72-83fffff09b8b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.268710 Aug 29 22:43:11.776089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 150/310] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:11 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:12.215116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:12.215984 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:12.224703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.225510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.226159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.227036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.227499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.228143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.276644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:12.280562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:12.293861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.294955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.299251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.301152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.302429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.303625 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.554513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:12.564370 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:12.566014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c6faa42d-f33b-46fc-aad1-1c2d2b2ae4fc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.355005 Aug 29 22:43:12.574369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:12.575777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 161/311] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:12 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:12.576402 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:12.577986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e92d7b4a-812b-4455-bc1b-a74ee52b0d09 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.318995 Aug 29 22:43:12.590764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:12.590764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:12.591551 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 151/312] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:12 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:12.596074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.596653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.597299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.599910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.600604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.601209 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.797153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:12.803189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:12.828303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.831924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.832584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.832828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:12.833870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:12.834513 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:12.835338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:12.849651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-60950a2e-927c-46aa-90f6-fbe05bf0ff40 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.271797 Aug 29 22:43:12.851080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 162/313] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:12 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:13.131406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:13.141324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d1f4f4a5-f4bb-403c-881a-706addbfedcf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.362292 Aug 29 22:43:13.142168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 152/314] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:12 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:13.602629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:13.604801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:13.606351 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:13.607161 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:13.614819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:13.615681 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:13.616376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:13.617338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:13.619224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:13.619822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:13.620061 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:13.620709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:13.621383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:13.622462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:13.623381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:13.624186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:13.952590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:13.969816 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8eccf469-68ad-4885-8fe6-f6f6331f38d4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.371205 Aug 29 22:43:13.978410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 163/315] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:13 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:13.989556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd5423a-56bc-4eb2-8285-f32a236db67a", "name": "network-vif-plugged", "status": "completed", "tag": "0aadfb69-64b9-4ed9-97ea-a90576f04ace"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:14.005921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:14.006699 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:14.007346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:14.021040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] Creating event network-vif-plugged:0aadfb69-64b9-4ed9-97ea-a90576f04ace for instance 5dd5423a-56bc-4eb2-8285-f32a236db67a on hv-cinder-85427 Aug 29 22:43:14.032158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-bfa7c3fb-0535-40e2-bc66-c825216ad40f req-21e4b9db-7b8e-400d-b03e-083c9954f15f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050997 Aug 29 22:43:14.037364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 164/316] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:14.044265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:14.045481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:14.059630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:14.073504 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:14.077376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:14.080466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-20eb3773-959f-4e15-86a4-2385e90fe0eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.477708 Aug 29 22:43:14.083834 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 153/317] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:13 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:14.092483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:14.103031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:14.103953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:14.104732 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:14.105213 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:14.105634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:14.131156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:14.200317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:14.201804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:14.237436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:14.242690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:14.246472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:14.251703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:14.253971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:14.257596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:14.678801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:14.697312 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-11bb49d2-809d-493e-854f-86e0a69cb9fb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.658189 Aug 29 22:43:14.701188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 165/318] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:14 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:14.788075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:14.824874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-84df6edc-3342-4426-82de-f9cbdc4372da tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.649641 Aug 29 22:43:14.847298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 154/319] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:14 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:15.025911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:15.026247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:15.040265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.041526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.042508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.043769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.044524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.045428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.117037 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:15.118399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:15.128015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.129055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.129911 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.130939 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.131627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.132275 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.587488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:15.616901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:15.629095 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:15.636002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0d032fce-1096-42cf-a718-e9f868665e67 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.525465 Aug 29 22:43:15.637310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 155/320] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:15 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:15.656791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:15.689537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8c7b11cd-3afc-45a4-9027-126fc613db7b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.672403 Aug 29 22:43:15.693564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 166/321] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:15 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:15.737055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:15.739638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:15.754975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.756309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.757618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.759702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.760831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.762105 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.878723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:15.880299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:15.919701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.929429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.931407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:15.933154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:15.934489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:15.935799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:16.148104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:16.168715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-be2524bc-092e-4087-af35-a808e04b85a6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1720 microversion: 2.1 time: 0.435773 Aug 29 22:43:16.182782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 156/322] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:15 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1720 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:16.336958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:16.346450 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6f105bb5-fe9f-4f10-b61f-56dee9183ce3 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1367 microversion: 2.1 time: 0.478653 Aug 29 22:43:16.347337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 167/323] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:15 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:16.685464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:16.687060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:16.727155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:16.729531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:16.730431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:16.733442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:16.739358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:16.740604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:16.744035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:16.746091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:16.773187 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:16.774754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:16.776090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:16.777779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:16.780252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:16.781769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.330546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.346257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-724fee60-3506-44fa-b40a-575d8049eaf5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.621339 Aug 29 22:43:17.347403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 168/324] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:16 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:17.362400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:17.365667 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:17.382913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:17.387029 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:17.389609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.392701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:17.396312 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:17.400191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.426963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.450316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.469722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.476299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d6777ae9-9e7b-47d3-ab57-60f51ff4b834 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.797923 Aug 29 22:43:17.478475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 157/325] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:16 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:17.488050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:17.490601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:17.516422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:17.518356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:17.520071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.521922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:17.523381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:17.525361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.760749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.805049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a79cc811-988d-4d20-b112-6450b2ded264 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1697 microversion: 2.1 time: 0.456032 Aug 29 22:43:17.806632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 169/326] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:17 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1697 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:17.847362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:17.866840 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:17.868226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:17.869245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:17.896905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:17.918921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-29b3c746-f1a8-4665-bd24-d02d8f74ae09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1557 microversion: 2.1 time: 0.437388 Aug 29 22:43:17.934139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 158/327] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:17 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1557 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:17.934463 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Going to try to start instance {{(pid=148457) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:43:17.970941 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:17.971565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:17.995433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.000611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.001581 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.002980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.004103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.005099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.052487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ed30a12f-ee41-4f50-bccd-2d49d5b24a99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action" status: 202 len: 0 microversion: 2.1 time: 0.211246 Aug 29 22:43:18.055172 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 170/328] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:43:17 2022] POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:43:18.100567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:18.103314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:18.124337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.125603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.127032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.128581 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.131649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.132875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.288357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-caf30b10-4504-4f94-a6e5-94e6c3fd9d30 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.324184 Aug 29 22:43:18.300152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 159/329] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:43:17 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:18.409532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:18.414945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:18.445390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.447785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.449602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.451200 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.455720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.457816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.660747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:18.698929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0660c13a-534f-42cb-8017-84beb4c12d43 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1706 microversion: 2.1 time: 0.622376 Aug 29 22:43:18.710840 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 171/330] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:18 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1706 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:18.739807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:18.741508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:18.772745 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.775074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.803907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:18.808815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:18.811311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:18.812044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:19.108556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:19.154081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6fa7416c-67ca-4642-a054-48cc237a5f26 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.755000 Aug 29 22:43:19.167464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 160/331] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:18 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:19.370478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:19.415804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:19.415804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:19.415804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9654303a-ede9-4c9c-9e3e-dc90686beea0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.696062 Aug 29 22:43:19.439681 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 172/332] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:18 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:19.752404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:19.753591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:19.766704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:19.767479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:19.768272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:19.769171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:19.770290 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:19.771389 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:20.167850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:20.198083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:20.199036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:20.199557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c0ff325a-edf7-421f-85f9-ceb9024aec55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1706 microversion: 2.1 time: 0.450766 Aug 29 22:43:20.203722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 161/333] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:19 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1706 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:20.212885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:20.214515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:20.215619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:20.218580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:20.224067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:20.225069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:20.450248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:20.451651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:20.501792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:20.507852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:20.509746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:20.511411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:20.512516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:20.515272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:20.536198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:20.601575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2c5248c0-9235-45bb-ad09-f5d4161b07b9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.388877 Aug 29 22:43:20.628716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 173/334] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:20 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:20.978999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:20.991093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:20.997175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:21.002850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e7c9fe73-1869-49a2-bd2f-1297945d8c7b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.560469 Aug 29 22:43:21.006841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 162/335] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:20 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:21.059818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-839988330", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:21.165644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] validate_networks() for None {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:43:21.241451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:21.252203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:21.264213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:21.265650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:21.266846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:21.268655 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:21.269818 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:21.270950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.365909 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:22.371463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:22.391954 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3111c574-8bc7-4bec-8cb5-06d16c304a80 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1706 microversion: 2.1 time: 1.158044 Aug 29 22:43:22.392843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 163/336] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:21 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1706 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:22.410693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:22.414756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:22.442194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.443279 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.444188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.445616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.448923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.449846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.479237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:43:22.482136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:43:22.486941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:43:22.490090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:43:22.491651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:43:22.525981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.526893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.531218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.539788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.541123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.546286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.596992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Getting quotas for project a2e66667ce1d4a8e87dc287d74ed6991. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:43:22.613120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Getting quotas for user 2d3be77ead284ca7a85a57179e37c457 and project a2e66667ce1d4a8e87dc287d74ed6991. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:43:22.653363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:43:22.656820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:43:22.715428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:22.759087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fcbd55e9-1f1e-4be4-8d8d-e042d8de324a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705877 Aug 29 22:43:22.770968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 174/337] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:43:22.780165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:22.781934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:22.797642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.798599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.799553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:22.802255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:22.803516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:22.804167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:23.265224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:23.297904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-85a6ae4c-3269-40ff-a0ce-c2d1084dbaae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.903397 Aug 29 22:43:23.303650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 164/338] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:22 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:23.328495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd5423a-56bc-4eb2-8285-f32a236db67a", "tag": "0aadfb69-64b9-4ed9-97ea-a90576f04ace"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:23.370049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:23.372932 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:23.373979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:23.401744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] Creating event network-changed:0aadfb69-64b9-4ed9-97ea-a90576f04ace for instance 5dd5423a-56bc-4eb2-8285-f32a236db67a on hv-cinder-85427 Aug 29 22:43:23.420022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:23.436104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-8f5a6f0e-f403-41ed-85f9-1e3489fa4f22 req-ecb88f40-ec8d-4489-a278-2e355daa5938 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125255 Aug 29 22:43:23.440545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 165/339] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:23.456236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:23.461244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:23.464165 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c427765b-ba2c-4a58-b5bd-6a7ba525dc34 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:23.468372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e7255115-7927-4cea-9db8-b97d62798d89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.694735 Aug 29 22:43:23.470903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c427765b-ba2c-4a58-b5bd-6a7ba525dc34 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:23.484717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 175/340] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:22 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:23.506335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:23.510501 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:23.511314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:23.545720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:23.546370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:23.546931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:23.547671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:23.558856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:23.559934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:23.679084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c427765b-ba2c-4a58-b5bd-6a7ba525dc34 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:23.709266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c427765b-ba2c-4a58-b5bd-6a7ba525dc34 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1214 microversion: 2.1 time: 0.260512 Aug 29 22:43:23.712723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 166/341] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:23 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:24.107310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:24.139919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-687f4270-b002-47c4-a401-c9061a3b7800 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1706 microversion: 2.1 time: 0.649045 Aug 29 22:43:24.154771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 176/342] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:23 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1706 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:24.341160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:24.342127 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:24.371605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:24.372657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:24.373181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:24.374469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:24.375336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:24.377324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:24.530916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:24.536575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:24.564281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:24.565642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:24.575366 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:24.577672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:24.579316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:24.583970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.062927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:25.092201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e5e96dc8-a2f0-4515-b65a-f7d55adb9455 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1520 microversion: 2.1 time: 0.754432 Aug 29 22:43:25.101500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 167/343] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:24 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1520 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:25.120003 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:25.125495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:25.143039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.144190 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.145570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.148204 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.149705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.150948 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.195293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:25.228641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:25.234292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:25.242282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-80eadc71-d133-47e2-ac20-10dedbe6959a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.728422 Aug 29 22:43:25.255660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 177/344] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:24 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:25.267115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:25.267895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:25.283712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.284371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.284939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.285800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.286371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.286962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.325851 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:25.343612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cc3558fa-5304-4a95-96f6-8fbf7833bbda tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1210 microversion: 2.1 time: 0.239165 Aug 29 22:43:25.346631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 168/345] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:25 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1210 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:25.515602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5d18e2-56b2-450a-879c-7fe8e6a87c77", "device": "/dev/sdb"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:25.518852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:25.539521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.540472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.553486 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:25.555133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:25.556329 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:25.562362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.108898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:26.170300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ce85e7a8-53be-42af-af8b-1e59cfef2546 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1710 microversion: 2.1 time: 0.912725 Aug 29 22:43:26.194165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 178/346] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:25 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1710 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:26.234053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:26.235088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:26.275958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.276795 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.279373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.289410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.294072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.304197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.551757 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-62e277b3-612f-4725-994d-feb8d12cb4a8 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "POST /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.038900 Aug 29 22:43:26.552657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 169/347] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:43:25 2022] POST /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:26.567579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:26.568709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:26.578037 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.579120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.579928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.580978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.581767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.582428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.887468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:26.903838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c7ee9881-c642-4e60-bbb7-439f24a3c083 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1500 microversion: 2.1 time: 0.687111 Aug 29 22:43:26.915465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 179/348] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:26 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1500 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:26.915465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:26.915465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:26.927467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.939539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.940293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:26.941219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:26.941852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:26.942453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:27.136130 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:27.157999 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-176baf76-bdaa-4fda-9b70-8261dc42ba50 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1274 microversion: 2.1 time: 0.251859 Aug 29 22:43:27.166979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 180/349] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:26 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:27.190002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:27.197696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:27.200463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:27.212195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:27.213390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:27.214386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:27.216766 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:27.218945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:27.220002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:27.227812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:27.242223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:27.245279 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-53fecf1c-2ee2-4d27-ad2e-f55bf6130bd7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.683027 Aug 29 22:43:27.246266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 170/350] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:26 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:27.547966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:27.561683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:27.567727 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-eefe26c6-ce1c-4fb4-9e0c-5e1556f44b49 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1515 microversion: 2.1 time: 0.396656 Aug 29 22:43:27.585459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 181/351] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:27 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:28.206605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:28.207230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:28.239002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:28.242273 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:28.243016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:28.244225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:28.248310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:28.253349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:28.293994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:28.301080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:28.342666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:28.346575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:28.354122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:28.355268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:28.360319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:28.361557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:28.481583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:28.510582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6ff16bfe-1d42-4d5a-b1ea-2fde74bf41bd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1272 microversion: 2.1 time: 0.305575 Aug 29 22:43:28.515556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 171/352] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:28 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:28.897547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:28.920903 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:28.928697 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:28.934030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-94068a7c-07a7-4961-bf0b-94164f1f7c4e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.647811 Aug 29 22:43:28.940019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 182/353] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:28 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:29.507848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:29.511683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:29.524831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.526043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.527053 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.529195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.530170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.530829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.558819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:29.560422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:29.568866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.569770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.570412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.571941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.572923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.573889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.743413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lazy-loading 'flavor' on Instance uuid 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:43:29.776188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:29.792197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-22e0de1a-282e-42a3-9f8e-28e68e282267 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.240640 Aug 29 22:43:29.794201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 183/354] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:29 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:29.888067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-27f831f4-f8df-490f-8c75-c3d602c7ca00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/action" status: 200 len: 32 microversion: 2.1 time: 0.387366 Aug 29 22:43:29.889186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 172/355] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:43:29 2022] POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/action => generated 32 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:43:29.902031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:29.902769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:29.910223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.910828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.911468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.912044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.912435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.912864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.959318 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:29.960014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:29.967517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.968005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.968435 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:29.969553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:29.970238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:29.970657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:30.213301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:30.222888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7cb4c202-f516-4d30-b67e-a2b0af7e8b3a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.324798 Aug 29 22:43:30.223624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 184/356] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:29 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:30.229273 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9762656-3203-41b2-9098-b02c212ac839", "tag": "84fbef97-14c8-4d9d-b641-54c02c455fa6"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:30.239708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:30.240921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:30.241659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:30.243755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:30.252840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:30.253978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] Creating event network-changed:84fbef97-14c8-4d9d-b641-54c02c455fa6 for instance f9762656-3203-41b2-9098-b02c212ac839 on hv-cinder-85427 Aug 29 22:43:30.255131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:30.259307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-b9da9fe2-a025-4370-8bab-1822cd02cadc req-1361053d-121c-4bb7-be09-d9d75ee974e7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034138 Aug 29 22:43:30.260218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 185/357] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:30.267255 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7919ad51-65ba-495b-abe1-6ba037b1ce19 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1738 microversion: 2.20 time: 0.302804 Aug 29 22:43:30.268299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 173/358] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:29 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:30.819468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:30.821364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:30.830069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:30.830621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:30.831303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:30.832466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:30.833245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:30.833995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:31.112495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:31.130348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-78126549-26ce-4a01-89ed-5aecefca68fd tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.315940 Aug 29 22:43:31.131147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 186/359] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:30 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:31.246613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:31.247552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:31.254210 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:31.254802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:31.255294 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:31.255945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:31.256396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:31.256821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:31.296623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:31.297645 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:31.308169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:31.309350 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:31.310295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:31.311557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:31.312353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:31.313073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:31.522816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:31.538065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f40bcca8-0abf-4dd2-88b3-52118bab98c0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.296574 Aug 29 22:43:31.550382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 174/360] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:31 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:31.565549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:31.576893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:31.578545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:31.579834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-447476cb-69f5-48f5-948d-cd3652380a9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.289201 Aug 29 22:43:31.580407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 187/361] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:31 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:32.153996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:32.154510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:32.160497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.160977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.161406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.162247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.162543 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.162986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.323001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:32.331893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f9b830dc-bd42-4f8a-8aa4-47081ce943c7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.181896 Aug 29 22:43:32.332466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 175/362] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:32 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:32.562477 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:32.563129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:32.570073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.570555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.571521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.572216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.572666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.573084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.573637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:32.605638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:32.606250 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:32.612606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.613093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.613532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.614933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:32.614933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:32.615197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:32.644543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=6 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:32.765676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:32.775838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e4d5d4ed-23d7-426d-98f7-f458253e0b6c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.217736 Aug 29 22:43:32.775838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 188/363] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:32 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:32.804109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:32.813283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:32.814618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:32.816044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e506eb45-191b-4e20-af34-352332af95a5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.214908 Aug 29 22:43:32.817070 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 176/364] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:32 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:33.356948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:33.357554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:33.363778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.364259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.364687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.365385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.365835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.366258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.398667 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "name": "network-vif-unplugged", "status": "completed", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:33.412554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.413427 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.414496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.427964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] Creating event network-vif-unplugged:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:43:33.433215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-773f2882-f504-4f40-bc80-a950b1176d97 req-8e4826af-a66b-4980-af5c-3f82f8c3178c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038319 Aug 29 22:43:33.434080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 177/365] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:33.538511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:33.546962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c05cc3a4-f677-4b2a-9e9f-a70db749c2c1 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.195409 Aug 29 22:43:33.547536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 189/366] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:33 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:33.796689 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:33.801054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:33.801749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:33.808295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.808773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.809210 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.809906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.810354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.810842 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:33.847325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:33.854409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.854924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.855349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:33.856044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:33.856498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:33.856917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:34.026400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:34.037378 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4a3bcc76-462f-4c2a-bf79-a7815fc7693b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.241675 Aug 29 22:43:34.046258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 178/367] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:33 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:34.059914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:34.069593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:34.072316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:34.072806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d7300b05-d990-4a66-a126-bc3f7c027e02 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.230727 Aug 29 22:43:34.073437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 190/368] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:33 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:34.568373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:34.568979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:34.575556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:34.576038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:34.576472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:34.577269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:34.577935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:34.578370 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:34.598043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:34.712964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:34.722137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c8c96786-a0b1-4659-8144-11bb15e9773b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.157595 Aug 29 22:43:34.722708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 179/369] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:34 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:35.062692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:35.063331 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:35.069720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.070203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.070663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.071873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.072330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.072756 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.103423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:35.103945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:35.109920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.110408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.110878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.111576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.112032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.112458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.252131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:35.260375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1b8007df-55ff-4e51-bc19-d89813861ff1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.202167 Aug 29 22:43:35.260953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 191/370] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:35 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:35.281538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:35.289679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:35.291160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:35.292313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-450c1cd3-f5eb-4a46-89d6-5368d0fdc136 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.193025 Aug 29 22:43:35.292871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 180/371] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:35 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:35.744152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:35.744793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:35.751001 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.751486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.751924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.752615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:35.753069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:35.753495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:35.883013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:35.890787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b5082a34-818a-4d09-889d-a773287e003b tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.151020 Aug 29 22:43:35.891357 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 192/372] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:35 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:36.281158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:36.281696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:36.288472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.288957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.289387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:36.290681 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.291221 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.291645 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:36.315897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:36.316504 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:36.323456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.323943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.324377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:36.325076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.325537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.325962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:36.486133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:36.498439 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1a246e6b-5c9d-47b8-8338-df228d5b57cf tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.220803 Aug 29 22:43:36.500638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 181/373] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:36 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:36.506298 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:36.515946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:36.517776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:36.519169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7c688a80-f44e-4099-bb99-ace3badf1917 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.207011 Aug 29 22:43:36.530949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 193/374] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:36 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:36.911417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:36.912027 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:36.918485 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.919393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.919554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:36.920125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:36.920575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:36.920998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:37.050318 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:37.058904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c36811b1-acb2-4422-80b1-c213c9af121a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.151302 Aug 29 22:43:37.059521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 182/375] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:36 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:37.521284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:37.521815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:37.528243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:37.528895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:37.529399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:37.530096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:37.530556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:37.531054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:37.553820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:37.555908 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:37.565078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:37.565795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:37.566451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:37.567391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:37.568158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:37.569152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:37.739073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:37.748199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-bea91875-b1a5-4017-9c74-c9c742dec3d3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.230814 Aug 29 22:43:37.748781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 194/376] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:37 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:37.754280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:37.763160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:37.764601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:37.765752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ffc813b0-6da2-4c56-aa58-966d5b641fa9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.217922 Aug 29 22:43:37.766301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 183/377] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:37 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:38.080399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:38.080930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:38.087385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.087873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.088307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.089002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.089455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.089878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.224136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:38.232472 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-49799a1b-3944-46cd-86a8-f53cca5bf689 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.156041 Aug 29 22:43:38.233178 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 195/378] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:38 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:38.769705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:38.771323 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:38.781245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.781846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.782266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.783093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.783555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.784426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.789345 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:38.789955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:38.797563 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.798066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.798497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.799240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:38.799698 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:38.800124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:38.986719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:38.993969 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:38.994886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a6b3187b-53d1-4125-898e-86a546300985 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.228978 Aug 29 22:43:38.995462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 184/379] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:38 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:39.002230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:39.003698 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:39.004850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f93c9e30-e169-4b01-ac13-a2f4566fbd3d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.219416 Aug 29 22:43:39.005399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 196/380] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:38 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:39.253330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:39.253936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:39.260612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:39.261099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:39.261537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:39.262247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:39.262701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:39.263153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:39.611702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:39.619893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cb7f787a-fb4c-41f9-88ca-7e091b2c91ce tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.370506 Aug 29 22:43:39.620450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 185/381] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:39 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:40.017022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:40.017660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:40.024833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.025354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.025791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.026520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.027021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.027453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.028056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:40.028519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:40.034854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.035334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.035765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.036456 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.036910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.037337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.221050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:40.224203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:40.228922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8a050c7d-48fc-482d-acbb-88f620db7b5d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.215748 Aug 29 22:43:40.229575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 197/382] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:40 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:40.232286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:40.233723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:40.234905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-906868fa-dca0-46e5-bf20-ac1a8961bb53 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.211233 Aug 29 22:43:40.235449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 186/383] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:40 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:40.640576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:40.641189 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:40.647218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.647699 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.648134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.648826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:40.649280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:40.649703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:40.778144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:40.786061 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ea917ef5-f015-489a-bc03-628b4c9c6b6e tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.149316 Aug 29 22:43:40.786631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 198/384] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:40 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:41.250001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:41.250631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:41.256595 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:41.257065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.257188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:41.257507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.257942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.258644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.259116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.259553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.263866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.264355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.264789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.265488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.265941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.266364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.270561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:41.476212 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:41.480078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:41.485086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-71ccca01-940e-421b-aff7-796abf3fe48b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.238860 Aug 29 22:43:41.485663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 187/385] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:41 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:41.488898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:41.490338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:41.491542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1ff43d87-cae0-4af8-ba86-1e42fd7940bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.238819 Aug 29 22:43:41.492269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 199/386] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:41 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:41.807884 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:41.808488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:41.814420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.814942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.815386 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.816080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:41.816534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:41.816955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:41.963670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:41.973046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ef64e943-839e-4117-a456-8b71c2463b13 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.169482 Aug 29 22:43:41.973816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 188/387] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:41 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:42.506064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:42.506679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:42.513306 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:42.513509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:42.513950 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:42.514144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:42.514319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:42.514909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:42.515358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:42.515775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:42.520489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:42.520974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:42.521408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:42.522106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:42.522557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:42.523008 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:42.710106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:42.714614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:42.719044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-009c39f3-2520-4398-a786-7c0903d0fb4f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.216309 Aug 29 22:43:42.719628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 200/388] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:42 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:42.723567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:42.724986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:42.726116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f51400b0-7a9d-4756-a783-f3524e68deef tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1720 microversion: 2.20 time: 0.216490 Aug 29 22:43:42.726662 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 189/389] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:42 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:42.993665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:42.994529 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:43.000536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.001129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.001571 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.002266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.002717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.003168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.132445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:43.140231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f8468f7f-fecd-4fe0-82d2-d252d711011c tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.150507 Aug 29 22:43:43.140804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 201/390] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:42 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:43.741062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:43.741660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:43.748125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.748611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.748751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:43.749175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.749301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:43.749722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.750174 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.750601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.755322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.755800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.756228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.756910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:43.757362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:43.757781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:43.963407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:43.971115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:43.972537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-47acd979-2851-4940-89cc-de76affd05f5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.234974 Aug 29 22:43:43.973386 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 190/391] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:43 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:43.979012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:43.980491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:43.982034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-58f20389-e2be-4e6b-9f50-55dffcceda3c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1723 microversion: 2.20 time: 0.237065 Aug 29 22:43:43.982964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 202/392] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:43 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:44.006042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "826207fb-19b1-4405-9df0-ee51b622dd00"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:44.010236 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:44.019166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.019894 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.020706 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.021509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.021965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.023299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.160179 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:44.160887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:44.175226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.175226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.175226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.175226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.175761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.175761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.331976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:44.343853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fef25571-22d5-4f33-b9fd-bf7966673839 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.187099 Aug 29 22:43:44.344522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 203/393] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:44 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:44.385567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-90a4cefa-bb46-4030-aa10-1b7827c13823 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.383748 Aug 29 22:43:44.386470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 191/394] 10.222.0.77 () {62 vars in 1364 bytes} [Mon Aug 29 22:43:44 2022] POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments => generated 188 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:43:44.616098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:44.616917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:44.625638 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.626388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.637191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.638437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.639125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.639562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.694224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=148457) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:43:44.766510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-968e09cf-45ee-4462-b5ba-40166f8b3ee2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/action" status: 202 len: 0 microversion: 2.20 time: 0.155672 Aug 29 22:43:44.767450 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 204/395] 10.222.0.77 () {62 vars in 1319 bytes} [Mon Aug 29 22:43:44 2022] POST /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:43:44.775846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:44.776446 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:44.783043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.783517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.784130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.784836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:44.785280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:44.785859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:44.926987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:44.946362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:44.947868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:44.949084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ffda6b64-7106-445f-b91e-5d8946048d3f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1809 microversion: 2.20 time: 0.177722 Aug 29 22:43:44.949649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 192/396] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:44 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:44.996764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:44.997309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:45.003358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.003833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.004261 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:45.004949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.005395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.005828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:45.182849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:45.191004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d8e5aaed-4888-4dee-b1a8-bea486710c10 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.198501 Aug 29 22:43:45.191568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 205/397] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:44 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:45.369630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:45.371254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:45.381042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.381927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.383891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:45.384785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.385419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.385875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:45.424308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:45.584648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:45.594720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-36c0f63e-c057-43af-b149-5c9fadc6fce2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.228758 Aug 29 22:43:45.595601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 193/398] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:45 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:45.974278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:45.974908 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:45.981967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.982438 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.982899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:45.983581 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:45.984083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:45.984502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:46.115000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:46.124697 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:46.126110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:46.127326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7343f60d-3501-404a-9b5c-83982c61cc82 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1749 microversion: 2.20 time: 0.156953 Aug 29 22:43:46.127879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 206/399] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:45 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:46.213602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:46.214206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:46.220995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:46.221473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:46.221907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:46.222596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:46.223072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:46.223496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:46.354304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:46.362588 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-67922186-5b27-4502-ba22-2eafc71d2f37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.153368 Aug 29 22:43:46.363177 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 194/400] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:46 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:46.616137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:46.616805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:46.623561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:46.624042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:46.624477 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:46.625164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:46.625616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:46.626037 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:46.751835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:46.759947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ef90dc72-3730-4666-a894-1e29f2fd5cd2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.147640 Aug 29 22:43:46.760506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 207/401] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:46 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:47.151073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:47.151574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:47.157619 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.158100 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.158541 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.159266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.159722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.160151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.300719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:47.309391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:47.310880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:47.312026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f1af08ca-a29d-44cb-8974-1603feccdc3e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1749 microversion: 2.20 time: 0.165457 Aug 29 22:43:47.312584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 195/402] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:47 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:47.384073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:47.384683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:47.391539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.392028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.392464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.393162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.393620 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.394046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.528982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:47.536682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2d807583-b9f0-4e8b-8227-d1995d8ff956 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.156483 Aug 29 22:43:47.537486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 208/403] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:47 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:47.781117 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:47.781641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:47.787717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.788203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.788639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.789384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:47.789841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:47.790277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:47.922002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:47.930061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b56d1d18-f17a-49ae-a71c-d4cca7c79924 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.152891 Aug 29 22:43:47.930631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 196/404] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:47 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:48.334117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:48.334720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:48.340672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.341150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.341581 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:48.342264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.342714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.343164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:48.477091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:48.485767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:48.487234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:48.488392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e79e8828-8821-49af-989f-db85d94d1794 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1749 microversion: 2.20 time: 0.158207 Aug 29 22:43:48.488959 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 209/405] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:48 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:48.557912 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:48.558554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:48.566079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.566191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.566613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:48.567343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.567797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.568231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:48.701490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:48.709747 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4e686c04-9a74-4f5c-b7ec-37dab4635f6e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.156261 Aug 29 22:43:48.710657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 197/406] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:48 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:48.950414 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:48.951071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:48.957279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.957764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.958203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:48.958930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:48.959386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:48.959809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:49.104569 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:49.112614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-370cab33-08cb-4789-94cd-8009b30770c3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.166082 Aug 29 22:43:49.113192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 210/407] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:48 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:49.512287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:49.512956 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:49.518990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:49.519478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:49.519917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:49.520616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:49.521068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:49.521493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:49.690333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:49.702062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:49.704181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:49.705647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-41f7e816-3fd8-44ec-817f-a6839c0302a6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1751 microversion: 2.20 time: 0.197750 Aug 29 22:43:49.706602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 198/408] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:49 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:49.733506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:49.734114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:49.741522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:49.742078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:49.742878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:49.743617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:49.744071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:49.744494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:49.906556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:49.914898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d625aa16-9ee1-4af2-a34e-6d2d6ea53bc7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.185322 Aug 29 22:43:49.915670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 211/409] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:49 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:50.136153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:50.137245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:50.143974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.144462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.144894 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:50.145586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.146038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.146458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:50.281989 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:50.289521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-656d89b1-7dbb-4665-b2e3-011de8aee5f3 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.159815 Aug 29 22:43:50.290074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 199/410] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:50 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:50.729995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:50.730592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:50.736700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.737299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.737589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:50.738301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.738770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.739194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:50.876951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:50.886029 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:50.887528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:50.888708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-45da6b7a-6d96-4d6e-afb7-299450ca3802 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.163069 Aug 29 22:43:50.889522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 212/411] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:50 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:50.936845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:50.937455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:50.943864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.944345 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.944780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:50.945481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:50.945937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:50.946359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:51.082859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:51.091320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ac331240-1b45-4c77-a88c-87b5abe75d8c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.158028 Aug 29 22:43:51.091867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 200/412] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:50 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:51.309870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:51.310671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:51.316630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:51.317113 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:51.317546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:51.318243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:51.318696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:51.319154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:51.447273 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:51.455368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-759a14c0-dd1c-4579-8b84-3d75e913f67a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.149656 Aug 29 22:43:51.455946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 213/413] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:51 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:51.911661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:51.912137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:51.918816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:51.919295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:51.919718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:51.920409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:51.920873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:51.921266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.062870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:52.072368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:52.073728 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:52.074912 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ee381b96-c9ec-4c39-88fa-9b3f9e2112ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.167324 Aug 29 22:43:52.075478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 201/414] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:51 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:52.112855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:52.113464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:52.120739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:52.121248 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:52.121666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.122369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:52.122848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:52.123275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.169610 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9762656-3203-41b2-9098-b02c212ac839", "name": "network-vif-plugged", "status": "completed", "tag": "84fbef97-14c8-4d9d-b641-54c02c455fa6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:52.184891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:52.185921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:52.186361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.199453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] Creating event network-vif-plugged:84fbef97-14c8-4d9d-b641-54c02c455fa6 for instance f9762656-3203-41b2-9098-b02c212ac839 on hv-cinder-85427 Aug 29 22:43:52.205037 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-c4db903f-9afd-4059-94cf-ceeb0664a078 req-3cd53b6f-e853-4dff-bf8c-363d028b21a6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039376 Aug 29 22:43:52.205799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 202/415] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:43:52.264477 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:52.267911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:52.273740 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f27b8770-6176-4956-913b-c64c66ce060c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.164779 Aug 29 22:43:52.283757 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 214/416] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:52 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:52.479181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:52.479877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:52.486269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:52.486783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:52.487220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.487919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:52.488367 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:52.488788 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:52.650673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:52.658462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6f340511-5b93-4b17-b8c6-cb340d7fff20 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.184207 Aug 29 22:43:52.659054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 203/417] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:52 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:53.100081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:53.100649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:53.102877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:53.112384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.113415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.114032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.114722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.115322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.116585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.295340 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:53.295969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:53.302485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:53.314953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:53.315940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.316441 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.316861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:53.316995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.319162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-71daef9d-d187-4958-9b70-cee5007b6d57 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.224668 Aug 29 22:43:53.319337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.319337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.319537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 215/418] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:53 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:43:53.332253 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.491942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:53.500046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3bba0900-53a1-447a-87ef-149b8e0aae00 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.209205 Aug 29 22:43:53.500669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 204/419] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:53 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:43:53.680829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:53.681333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:53.690924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.690924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.690924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.690924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:53.693625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:53.693625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:53.830839 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:53.840108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-73334821-9152-4228-8b30-f83a9b7e222a tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.163141 Aug 29 22:43:53.840703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 216/420] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:53 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:54.347019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:54.347650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:54.350207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=78 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:54.356928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.357416 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.357855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:54.358565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.359054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.359525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:54.521561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:54.522061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:54.522198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:54.529394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.529915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.530346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:54.531105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.531554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.531972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:54.532089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:54.533666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:54.535303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5c29e455-4aff-46d9-9876-7293a1a0f74f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.192466 Aug 29 22:43:54.535982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 205/421] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:54 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:54.698953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:54.707203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-870af7af-3b4c-4bce-9691-f8977ecab214 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.189253 Aug 29 22:43:54.707657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 217/422] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:54 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:54.862991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:54.863610 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:54.871426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.872068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.872669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:54.873898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:54.874672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:54.875274 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:55.060512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:55.070861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7021c7ce-a38a-4bfc-938d-5c2481a4defe tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.211615 Aug 29 22:43:55.071634 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 206/423] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:54 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:55.563954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:55.564541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:55.571180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:55.571657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:55.572081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:55.572778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:55.573230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:55.573645 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:55.707323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:55.716027 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:55.717461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:55.718923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ab6dcaf0-a73c-448d-9eeb-c08ed868d979 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.158619 Aug 29 22:43:55.719484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 218/424] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:55 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:55.729141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:55.729722 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:55.736568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:55.737048 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:55.737478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:55.738168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:55.738630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:55.739065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:55.877568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:55.886240 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f4048784-0cdc-42cd-9d3d-8739ad9af32c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.161361 Aug 29 22:43:55.886867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 207/425] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:55 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:56.092941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:56.093492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:56.099832 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.100308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.100737 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:56.101996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.102458 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.102944 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:56.239215 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:56.246770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-540ca471-4c94-466f-9e5e-fc1ca4202fdc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.157749 Aug 29 22:43:56.247755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 219/426] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:56 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:56.741583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:56.742673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:56.749330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.749810 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.750246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:56.750985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.751432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.751859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:56.887199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:56.895862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:56.897316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:56.898471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-07c44a22-5764-4e16-847d-ce1c0d0cb03a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.160922 Aug 29 22:43:56.899139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 208/427] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:56 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:56.907729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:56.908318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:56.921071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.921549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.921977 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:56.922670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:56.923152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:56.923568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:57.084962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:57.093871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9e82caaf-4213-442c-a02c-e4b068d0014f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.189711 Aug 29 22:43:57.094444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 220/428] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:56 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:57.275000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:57.275736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:57.284074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:57.284739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:57.285237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:57.286006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:57.286515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:57.287050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:57.432332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:57.440987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d39e5bb1-e2f9-4293-8c17-014ee394387d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.172223 Aug 29 22:43:57.441572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 209/429] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:57 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:57.921938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:57.922649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:57.928823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:57.929964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:57.930462 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:57.931193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:57.931644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:57.932076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:58.076482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:58.086060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:58.095401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:58.096777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d27731b2-ceaf-43c8-a5a6-9ab54642ebe0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.178735 Aug 29 22:43:58.097420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 221/430] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:57 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:58.114981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:58.115586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:58.122993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:58.123469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:58.123900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:58.124593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:58.125042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:58.125511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:58.271557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:58.276361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:58.282041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-60bc823d-05fc-44f5-8a22-192492321491 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.170831 Aug 29 22:43:58.282815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 210/431] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:58 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:58.465038 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:58.466074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:58.472902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:58.473390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:58.473826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:58.474538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:58.475032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:58.475459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:58.626601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:58.638481 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-eacc5d67-becf-41c6-83e2-d38f80ed64fc tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1314 microversion: 2.1 time: 0.177893 Aug 29 22:43:58.639588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 222/432] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:58 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:59.120460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:59.121094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:59.128403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.129287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.129994 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.131209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.135168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.135168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.269272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:59.278025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:59.279505 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:59.280675 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b50a74f1-491f-4f6c-afe0-5f81b790302c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.164630 Aug 29 22:43:59.281226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 211/433] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:43:59 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:59.303778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:59.305075 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:59.311752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.312227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.312663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.313348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.313798 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.314224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.452665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:59.460338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7e2327e2-0f00-498f-bb89-e22541f0d829 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.160459 Aug 29 22:43:59.460961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 223/434] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:59 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:59.666448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:59.667309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:59.673883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.674309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.674756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.675478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.675957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.676385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.832798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:43:59.841038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8d446583-cd9f-4fe6-aa24-8b30a5502fe2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1464 microversion: 2.1 time: 0.181887 Aug 29 22:43:59.841601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 212/435] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:43:59 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:59.889799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:59.890304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:43:59.896621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.897084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.897519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.898778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:59.899243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:59.899670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:59.930905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:44:00.019178 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-eaab9ed4-4701-44ac-9628-e1b87d03fb27 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "DELETE /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 204 len: 0 microversion: 2.1 time: 0.132956 Aug 29 22:44:00.019865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 224/436] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:43:59 2022] DELETE /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:44:00.029629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:00.030234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:00.036320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.036809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.037247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.037948 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.038411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.038907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.190455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:00.200435 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bc411eef-48ac-40d3-9982-02771fafbd83 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.175130 Aug 29 22:44:00.201613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 213/437] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:00 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:00.304758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:00.305767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:00.312662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.313151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.313570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.314271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.314715 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.315184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.463272 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:00.472157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:00.473670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:00.474980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4812f6fb-67fa-4f4a-9890-4ac19776d9a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.174798 Aug 29 22:44:00.475553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 225/438] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:00 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:00.482222 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:00.483055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:00.489130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.489615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.490051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.490767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:00.491226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:00.491660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:00.634860 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:00.642957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d204bdbd-3a56-49df-9bf8-dec5dab2c201 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.164732 Aug 29 22:44:00.643525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 214/439] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:00 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:01.224167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:01.226196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:01.232861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.233642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.234081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.234846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.235304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.235865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.376154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:01.384363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-239e8c8e-21a4-442b-ab54-4a53f1fa20b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.164098 Aug 29 22:44:01.384946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 226/440] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:01 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:01.498281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:01.498849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:01.505626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.506121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.506579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.507369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.508376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.508808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.660002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:01.660534 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:01.667128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.667611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.667727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:01.668039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.668734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.669182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.669600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.677584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:01.679089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:01.680842 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9cd178eb-5346-48b0-9a83-6d2b5dfd3edd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.186723 Aug 29 22:44:01.681401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 215/441] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:01 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:01.686036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:01.686597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:01.693130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.693620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.694063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.694798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:01.695278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:01.695705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:01.811285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lazy-loading 'services' on Instance uuid 6bfb8e85-df7b-4481-9900-647fadc1bd32 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:01.834697 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:01.842970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c92c4b92-d379-4766-baff-b208326b83bb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.160491 Aug 29 22:44:01.844105 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 216/442] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:01 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:01.940108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-611dd900-8912-4dd5-b1a2-218281734abf tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "DELETE /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32/os-volume_attachments/7e5d18e2-56b2-450a-879c-7fe8e6a87c77" status: 202 len: 0 microversion: 2.1 time: 0.285405 Aug 29 22:44:01.940833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 227/443] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:44:01 2022] DELETE /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32/os-volume_attachments/7e5d18e2-56b2-450a-879c-7fe8e6a87c77 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:44:02.407014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:02.408125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:02.416366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.417927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.418930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.419900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.420568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.421194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.579293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:02.587708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-dabb9dc9-55ea-4856-a205-2373bac700b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.186388 Aug 29 22:44:02.588267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 217/444] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:02 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:02.707375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:02.709166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:02.730104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.731039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.731847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.733812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.734631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.735362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.865773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:02.866680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:02.875107 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.875891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.876322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.877215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:02.877663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:02.878083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:02.918997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:02.928199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:02.930495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:02.932181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fcb62ee8-87b8-4835-8306-995ac8f8f164 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.231418 Aug 29 22:44:02.933243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 228/445] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:02 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:03.076198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:03.087501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a4fc1c28-2d2b-4d9e-87c6-90696e2bb198 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1501 microversion: 2.1 time: 0.225658 Aug 29 22:44:03.088352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 218/446] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:02 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:03.112771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34bb3ddf-86c7-4c50-bbb3-1918135ae919"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:03.115547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:03.123099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.123595 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.124034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.124920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.125381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.125807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.131362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:03.164603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] HTTP exception thrown: Cannot 'attach_volume' instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a while it is in vm_state rescued Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Request method failure captured: Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/os-volume_attachments HTTP/1.1 Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 74 Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUDPMUFH2PrfWVx5qSdxVYWft2KxPLMI2cOV9TV7arGTPNVZ3nWwucj-36kRePsg1Fef1-K2zRx6d9OPNV8AChtC5q5Wmn2xPqUU24fb00xGE_V2vrZAw9jPIXaPBuUl9-Bw6lP25Gx513vnRr-G1PUTGZV5BHG2QrHmAm5z3WJVxRg Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:44:03.166293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_8ad722485ac34d1796f03003fbcde07a", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}] Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 8b46b3fa1df24c80ab7315c4ff44c064 Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {"volumeAttachment": {"volumeId": "34bb3ddf-86c7-4c50-bbb3-1918135ae919"}} Aug 29 22:44:03.168017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Cannot 'attach_volume' instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a while it is in vm_state rescued Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'server_id': '9e78f6ed-61b5-43c7-acd0-82d594ac1a2a', 'body': {'volumeAttachment': {'volumeId': '34bb3ddf-86c7-4c50-bbb3-1918135ae919'}}} Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:03.168949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a while it is in vm_state rescued Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:03.170780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a while it is in vm_state rescued Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Returning 409 to user: Cannot 'attach_volume' instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a while it is in vm_state rescued {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7c1b1967-6e6f-4cfd-a7cd-d3c210dd2c82 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062799 Aug 29 22:44:03.172065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 229/447] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:44:03 2022] POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 22:44:03.179368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:03.181998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:03.188556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.189054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.189483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.190182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.190620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.191261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.276295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9717bbd9-dc42-426c-9f4d-b59709ead4f8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.100849 Aug 29 22:44:03.277040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 219/448] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:44:03 2022] POST /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:03.289266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:03.290310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:03.297691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.298419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.299505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.300575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.301279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.302005 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.479094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:03.487426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d3f04bf9-e9a3-4bba-84aa-38a8e7787427 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.204541 Aug 29 22:44:03.487988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 230/449] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:03 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:03.610424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:03.611107 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:03.620039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.621013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.621013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.621766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.622305 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.622874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.778395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:03.786682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-52c4b531-d2df-4f19-9d02-29acd1419089 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.181398 Aug 29 22:44:03.787302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 220/450] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:03 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:03.960139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:03.960897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:03.967425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.967866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.968300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:03.969259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:03.969712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:03.970132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.135999 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.146168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.147680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.149373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-afb99189-3ded-4131-a0ef-4cb73c947f65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.193248 Aug 29 22:44:04.150122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 231/451] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:03 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:04.514359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:04.515535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:04.522654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.523654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.524251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.524949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.525409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.525821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.680711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.691145 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bddc04e0-ed70-485b-9efe-e188d5874a71 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.185109 Aug 29 22:44:04.692081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 221/452] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:04 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:04.809551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:04.810150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:04.816216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.816695 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.817122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.817820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.818265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.818683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.983357 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.996808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-693a164c-241a-4ad6-a7ec-97e38b79cab0 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.190991 Aug 29 22:44:04.997398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 232/453] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:04 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:05.175137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:05.176845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:05.188316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.188936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.189805 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:05.191064 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.191751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.192421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:05.349200 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:05.364739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:05.366645 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:05.368091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d8c939e4-a1ed-4fcb-853d-436a29e0c78a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.198517 Aug 29 22:44:05.368648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 222/454] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:05 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:05.716594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:05.717101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:05.724035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.724483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.724925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:05.725645 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.726107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.726551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:05.899844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:05.908000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-353b8d79-1dd6-4263-ac3c-9a229d2b4a04 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.195488 Aug 29 22:44:05.908562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 233/455] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:05 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:06.019342 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:06.019969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:06.027096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.027574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.028001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.028695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.029137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.029780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.220775 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.230821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-75b633c8-bd68-43ae-85b4-543bdaadb560 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.215503 Aug 29 22:44:06.232092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 223/456] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:06 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:06.399102 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:06.399776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:06.407335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.407959 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.408497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.409295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.409924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.410514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.613637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.626226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.627996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.629400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fdd36ab0-e66b-4e2e-acfd-4aff08650aee tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.236130 Aug 29 22:44:06.630358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 234/457] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:06 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:06.932920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:06.933859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:06.942189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.942920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.943369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.944187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.944761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.945696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.129336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.143376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1bacdefc-3aed-45b7-95ea-bed5231ad180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.216894 Aug 29 22:44:07.144728 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 224/458] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:06 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:07.242841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9762656-3203-41b2-9098-b02c212ac839", "name": "network-vif-unplugged", "status": "completed", "tag": "84fbef97-14c8-4d9d-b641-54c02c455fa6"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:07.256744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:07.258464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:07.267687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.268406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.268883 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.269112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.269558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.269992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.270536 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.271248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.271891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.295354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] Creating event network-vif-unplugged:84fbef97-14c8-4d9d-b641-54c02c455fa6 for instance f9762656-3203-41b2-9098-b02c212ac839 on hv-cinder-85427 Aug 29 22:44:07.301880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-4b504c52-90f5-44c3-9226-2dee0aae27d8 req-d873dd20-5675-402e-994c-88886b853f33 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063717 Aug 29 22:44:07.307819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 235/459] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:07.462719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.471479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fc2b4db6-b5d2-4225-8a06-af23cba55b1d tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.219465 Aug 29 22:44:07.471958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 225/460] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:07 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:07.654699 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:07.655872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:07.662293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.662880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.663664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.664387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.664846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.665274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.849760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.859486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.860955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.862127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-959ed9a0-7227-4a63-b1fd-0b54385d422e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.212210 Aug 29 22:44:07.862682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 236/461] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:07 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:08.172880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.173507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.180459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.180940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.181379 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:08.182074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.182532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.182991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:08.202470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:08.337795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.350687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9dfd40c9-0404-4584-9a8a-573a1e61f320 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.181412 Aug 29 22:44:08.352311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 226/462] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:08 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:08.494125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.494759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.501618 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.502074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.502513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:08.503283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.503783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.504224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:08.683478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.698234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4742d5ce-1642-4fed-8a62-a447c912e9ee tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.208297 Aug 29 22:44:08.699111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 237/463] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:08 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:08.887110 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.887710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.894306 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.897809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.898364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:08.899773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:08.900482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:08.900917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.048959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.058320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.059788 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.060942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-aaac68b4-5a9f-4af1-b7f1-3d72d3e96d52 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.177872 Aug 29 22:44:09.061494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 227/464] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:08 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:09.375712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.376182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.383143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.383628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.384059 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.384748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.385195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.385611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.544557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.553193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b688842e-092a-4c50-9783-9e3c9d7a55ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.183248 Aug 29 22:44:09.553841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 238/465] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:09.724830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.727494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.750370 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.751194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.751889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.754391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.754391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.754391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.955969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.964241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5615502e-77ef-43c8-a307-2409ad2eb250 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.243808 Aug 29 22:44:09.964816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 228/466] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:10.085482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.086478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.094973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.095609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.096116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.096904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.097440 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.098094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.259861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.270957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.272415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.274671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6bfcf417-5746-4668-a08e-7bb7f66c3cc0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.192799 Aug 29 22:44:10.275948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 239/467] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:10.588228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.588228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.591857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.592450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.592886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.593913 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.594363 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.594845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.751744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.759807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cb179f89-6f30-4e4c-823a-fbf262562224 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.188573 Aug 29 22:44:10.760383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 229/468] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:10.990369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.991028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.997661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.998429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.998894 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.999605 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.000317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.001019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.150580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.163521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b720812c-7f05-4a10-93b1-f859220b2503 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.177705 Aug 29 22:44:11.168749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 240/469] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:11.301756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.302777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.310443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.311243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.311680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.312420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.312874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.313297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.461337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.470848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.472296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.473453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4d28cd19-159c-4892-b5e0-c45bafae10d3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.177001 Aug 29 22:44:11.474014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 230/470] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:11.782783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.783755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.792492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.793424 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.793568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.794344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.794921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.795394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.964671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.973644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3ecffe0f-ba6c-42b4-9ad4-38ffe1e0ad37 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.195526 Aug 29 22:44:11.974245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 241/471] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:12.185509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:12.186848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:12.199152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.206352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.207204 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.208188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.208847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.209512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.398640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.406331 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d4ef9ef9-0b9f-4ae0-b2d0-96da19ee79cb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.225545 Aug 29 22:44:12.407148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 231/472] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:12.496415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:12.497060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:12.503916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.504406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.504837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.505546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.505997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.506431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.661285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.671443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.674068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.676238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f731c2aa-4870-468d-b257-cfc74cb987e3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.183445 Aug 29 22:44:12.677449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 242/473] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:13.002756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.003519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.010584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.011109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.011547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.012259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.012717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.013143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.145837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.154144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-215f9c7d-d7a6-4349-93b1-6f64b14a6140 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.155411 Aug 29 22:44:13.154715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 232/474] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:13.431116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.431701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.439088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.439652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.440137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.440923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.441418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.441851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.572317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.580288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-22b280c4-32b7-4dc4-9838-18ded5d2b2f7 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.153888 Aug 29 22:44:13.581186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 243/475] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:13 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:13.701631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.702196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.708814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.709333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.709772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.710999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.711450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.711877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.939084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.948819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.950258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.951869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c9f5f848-18b5-492a-99cc-031ffa1893a0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.254043 Aug 29 22:44:13.952559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 233/476] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:13 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:14.175162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.175788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.181992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.182493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.182972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.184048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.184248 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.184851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.331260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.339188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-14ab3f68-07fa-4c10-a630-305415b5688c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.167890 Aug 29 22:44:14.339767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 244/477] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:14.602213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.602882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.608888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.609359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.609784 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.610465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.610942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.611363 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.742498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.752060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c8d42c9e-ecc7-4dd6-8094-91aacc5902e8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1470 microversion: 2.1 time: 0.151834 Aug 29 22:44:14.754191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 234/478] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:14.977203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.977829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.984757 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.985562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.986210 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.987051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.987518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.987954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.167205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.178220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.180213 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.181471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6e86f110-9000-46cf-9dd3-4e1f745ee6f4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.209321 Aug 29 22:44:15.182066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 245/479] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:15.363492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.364089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.377018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.377520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.383156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.384938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.385584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.386163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.648637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.667608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ede67d1b-de03-432b-9b8b-72ea1ad1dbb6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.309695 Aug 29 22:44:15.668889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 235/480] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:15.777573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.778221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.796847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9762656-3203-41b2-9098-b02c212ac839", "name": "network-vif-deleted", "tag": "84fbef97-14c8-4d9d-b641-54c02c455fa6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:15.804324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.805694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.806145 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.807495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.808579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.809244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.820120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.821035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.821849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.848879 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] Creating event network-vif-deleted:84fbef97-14c8-4d9d-b641-54c02c455fa6 for instance f9762656-3203-41b2-9098-b02c212ac839 on hv-cinder-85427 Aug 29 22:44:15.854843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-4c049fd2-63a2-40a1-9524-98af7afad686 req-5bcfa4e2-4947-4b6f-aa36-e19b9f8119f6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062278 Aug 29 22:44:15.856019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 236/481] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 22:44:15.917812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.921758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:15.927461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e3c3e72b-4d0e-4c1e-a805-8a6f9716f9f2 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1299 microversion: 2.1 time: 0.153769 Aug 29 22:44:15.928314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 246/482] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:15.977529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.978117 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.984939 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.985429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.985863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.986586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.987080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.987514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.012889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:44:16.098478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-53c6b3ff-122d-411f-a667-496735656c97 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "DELETE /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 204 len: 0 microversion: 2.1 time: 0.125625 Aug 29 22:44:16.099106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 237/483] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:44:15 2022] DELETE /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:44:16.108508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.109110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.115805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.116847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.117402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.118098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.118546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.118989 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.209819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.210926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.221919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.222406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.222881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.224398 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.224903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.226705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.262938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.274540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-48cf6fa9-3dc2-4856-886f-fddec5546009 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1515 microversion: 2.1 time: 0.168944 Aug 29 22:44:16.276023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 247/484] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:16.406698 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.416311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.417699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.418993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f59ee9e7-66f9-43e6-908c-4b9648226e6d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.213385 Aug 29 22:44:16.419552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 238/485] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:16.708257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.708927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.718316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.719203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.719691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.721269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.721994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.722762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.903696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.911425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3bc661fc-d44b-42b0-ae66-69dccbedda84 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.210363 Aug 29 22:44:16.912012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 248/486] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:16.951982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.952542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.959015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.959508 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.960561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.961266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.961726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.962163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.994033 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.994515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.994988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.995439 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:17.046809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.054716 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-115a02b9-076a-447a-8088-f63427987ebf tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.106984 Aug 29 22:44:17.055311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 239/487] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:17.301576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.302348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.309755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.310249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.310684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.311436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.311889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.312343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.446369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.447487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.455362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.457252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.458047 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.458841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.460317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.460471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.460803 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.463603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f5edab59-42d2-4950-9694-5fa7e2f9a0f0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1515 microversion: 2.1 time: 0.166123 Aug 29 22:44:17.464188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 249/488] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:17.593271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.602117 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.603592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.604764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8988c5db-65ab-4424-8117-e0f3aed1e71d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.165741 Aug 29 22:44:17.605370 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 240/489] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:17.639038 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.639533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.646884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.647410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.647855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.648553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.649010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.649437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.676293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8491ec74-51f9-4b35-b13d-f5e3ed55d8d5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/ips" status: 200 len: 149 microversion: 2.1 time: 0.041009 Aug 29 22:44:17.676930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 250/490] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:17.688871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "109897a1-6d0a-43f5-82a0-0cfa18eb5bbb"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:17.691300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.697529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.698011 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.698489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.699175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.699633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.700057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.778132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:17.783102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: POST /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/os-volume_attachments HTTP/1.1 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 74 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:44:17.785346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {"volumeAttachment": {"volumeId": "109897a1-6d0a-43f5-82a0-0cfa18eb5bbb"}} Aug 29 22:44:17.786973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'server_id': '5dd5423a-56bc-4eb2-8285-f32a236db67a', 'body': {'volumeAttachment': {'volumeId': '109897a1-6d0a-43f5-82a0-0cfa18eb5bbb'}}} Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:17.791838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:17.793310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 400 to user: Invalid volume: volume 109897a1-6d0a-43f5-82a0-0cfa18eb5bbb is already attached to instances: e48a61e3-953a-41a2-a47f-96f40b362e3e {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5ad73e3b-02ea-42bd-905d-9122dd2e51f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101956 Aug 29 22:44:17.794719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 241/491] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:44:17 2022] POST /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:44:17.796675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.797169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.803372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.804433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.804877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.805593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.806056 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.806478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.832630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:44:17.912789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9e900ce8-9855-4f86-a49a-d15d162d31f7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 204 len: 0 microversion: 2.1 time: 0.119658 Aug 29 22:44:17.913904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 251/492] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:44:17 2022] DELETE /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:44:17.930575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.930575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.937395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.939140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.944296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.944955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.945143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.945584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.945868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.946387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.947016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.947339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.947769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.947943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.948242 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.948504 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.183085 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.187511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.191370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1a141311-85f8-4b89-9414-454f6465b31c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.258516 Aug 29 22:44:18.192080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 252/493] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.197291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.197897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.199460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d76402da-f8cb-4286-8f63-c0397b8907d2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1681 microversion: 2.1 time: 0.279366 Aug 29 22:44:18.203797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.204281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.204645 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 242/494] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.204776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.205399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.205852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.206277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.253574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.254176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.254515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.254998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:18.309428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.318597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3267a681-ad13-4739-ae3f-53a3118938f8 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.125316 Aug 29 22:44:18.319275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 253/495] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.487750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.488362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.494457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.495097 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.495544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.496259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.496716 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.497144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.628107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.628723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.629978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.635505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.636020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.636963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.637275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.637732 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.638157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.638559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7d5685a2-aa06-4fed-a51d-cf897967d812 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1515 microversion: 2.1 time: 0.154692 Aug 29 22:44:18.639171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 243/496] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.673991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.674524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.681331 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.681892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.682333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.683175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.684343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.684343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.779788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.798623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.800090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.801284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-101f835d-099d-4155-b655-9bf059e7de96 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.177254 Aug 29 22:44:18.801846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 254/497] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:18.837301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'services' on Instance uuid 69f655b3-78d2-40f5-ac78-806952dba34b {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:18.973108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fc677d21-6642-4ce3-9759-2d2b7cdee0ee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments/0e3a2d59-7960-4447-a518-6e33731503a3" status: 202 len: 0 microversion: 2.1 time: 0.301574 Aug 29 22:44:18.973108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 244/498] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:44:18 2022] DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments/0e3a2d59-7960-4447-a518-6e33731503a3 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:44:19.225734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.226352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.229191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.231057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.234174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.234834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.235146 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.235850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.236283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.236410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.236752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.236867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.237181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.237947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.238395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.238840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.487388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.496160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-965f1e73-94cb-4640-8a60-e740fd221c7a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.274000 Aug 29 22:44:19.507553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 255/499] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:19.514820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.518669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.519407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.525255 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ca7b6da9-5080-4362-bb9a-220426b7456f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1681 microversion: 2.1 time: 0.300283 Aug 29 22:44:19.526031 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 245/500] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:19.526366 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.527197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.527656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.528432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.528896 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.529380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.566552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.567076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.567509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.567957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:19.614165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.624664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-33c08ea6-1848-4d8f-87a7-3c63d23480ff tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.126453 Aug 29 22:44:19.625255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 256/501] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:19.663424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.663988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.670458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.671010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.671492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.672223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.672680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.673106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.812119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.820711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-db5cc3be-04a3-492c-b93b-d591fbd65efa tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1515 microversion: 2.1 time: 0.161621 Aug 29 22:44:19.821656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 246/502] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:19.826535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.827184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.829219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:19.834916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.835411 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.835842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.836540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.836985 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.837402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.973743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.983256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.984692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.985856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-03bd6ba3-284f-41fa-9e56-eef2017399ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.163483 Aug 29 22:44:19.986413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 257/503] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:20.518988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.519601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.527483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.527968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.528401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.529093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.529563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.530003 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.555116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.555734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.564065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.564561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.564994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.565692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.566146 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.566592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.748776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.757631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-67ef793e-5b1f-492d-b833-b426dd5b840a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1509 microversion: 2.1 time: 0.241896 Aug 29 22:44:20.758127 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 247/504] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:20.762751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.762974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.763660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.769751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.770453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.771078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-19eb6970-35b4-4e6a-a133-daa3cf446517 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1681 microversion: 2.1 time: 0.220953 Aug 29 22:44:20.771228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.771786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 258/505] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:20.772090 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.773459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.773890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.804766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.805248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.805684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.806128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:20.843764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.844370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.847857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.850249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.851311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.852063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.852633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.853080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.853496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.857817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-de6c2566-90df-429f-8886-7b6cb7a677fb tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.098673 Aug 29 22:44:20.858396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 248/506] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:20.985874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.994153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-547824ec-bca0-4498-8f1b-7aeaa6b38205 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1515 microversion: 2.1 time: 0.154559 Aug 29 22:44:20.994696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 259/507] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:21.009122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:21.009721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:21.016302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.016778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.017238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.017926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.018372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.018819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.179799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.189136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.190559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.191733 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bcb5c5c2-d67e-43b0-8ac2-f308d3755f89 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.186609 Aug 29 22:44:21.192286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 249/508] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:21 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:21.779567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:21.780372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:21.794422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:21.795608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:21.809697 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:21.827334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.827739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.828323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.828823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.829732 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.830140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.832280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.832996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.837171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.838429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.839889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.840703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.205297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.216195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ef559821-c400-4062-b2c0-348020515206 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1681 microversion: 2.1 time: 0.425958 Aug 29 22:44:22.222275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.227972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 250/509] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:21 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1681 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:22.234841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-abfc520d-a35f-4e4f-b4f6-6dbc213e68e0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1515 microversion: 2.1 time: 0.459442 Aug 29 22:44:22.235594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 260/510] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:21 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:22.240093 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.240692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.247610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.248494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.248794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.249492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.250096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.250665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.251916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.252534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.260543 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.261724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.274236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:22.275106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.276469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.278884 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.279564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.322680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.324776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.325591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.326523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:22.410126 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.423002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5b2cea9e-5aee-4580-b129-6fbba957317a tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1473 microversion: 2.1 time: 0.185931 Aug 29 22:44:22.423145 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 261/511] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:22.427916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.429499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.436965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.437803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.438465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.439688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.440419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.441003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.487955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.501119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-759a92fd-2e8d-4f00-b89c-15875e3f9a38 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.271656 Aug 29 22:44:22.501725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 251/512] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:22.578334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfb8e85-df7b-4481-9900-647fadc1bd32", "name": "network-vif-deleted", "tag": "626598b1-3252-4a55-a7ba-a75d9650dc20"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:22.589745 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.590292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.590955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.604712 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] Creating event network-vif-deleted:626598b1-3252-4a55-a7ba-a75d9650dc20 for instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 on hv-cinder-85427 Aug 29 22:44:22.610831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-3dd85f32-5d63-4abd-8b9f-450f353ae092 req-558f4a22-ca32-4fcc-b5a0-c4e95c3d336f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042737 Aug 29 22:44:22.611823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 252/513] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:22.703483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.713358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.714532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.716456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-05a11bc8-883d-43a7-b927-4a918b21b473 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.292319 Aug 29 22:44:22.718767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 262/514] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:23.242974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.243978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.254455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.254757 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.255627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.256990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.257683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.258686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.462701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.466607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.470170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.480428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fcb1347b-672b-46f1-9260-8b5e0a4d929c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1681 microversion: 2.1 time: 0.241687 Aug 29 22:44:23.481580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 253/515] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:23.488917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.491155 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.491911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.493714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.495012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.497576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.525382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.526170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.532731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.533354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.534270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.535018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.535482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.535915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.549976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.550841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.551517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.552159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lazy-loading 'fault' on Instance uuid 6bfb8e85-df7b-4481-9900-647fadc1bd32 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:23.581073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.581648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.582101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.582564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:23.600913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.609074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-79d4ccd5-87e2-44ab-a9f1-d6acf5aaf81f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1309 microversion: 2.1 time: 0.153522 Aug 29 22:44:23.610250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 263/516] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:23.648149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.661448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f18124bd-09ee-4094-88bd-56ff50a3eff5 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.141861 Aug 29 22:44:23.675322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 254/517] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:23.742448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.743102 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.753696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.754307 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.754780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.755572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.759069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.759627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.769994 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7885270a-225e-4fc2-b736-32284661dffe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: .version_select at 0x7f5cf6e28430>, body: {"keypair": {"name": "tempest-keypair-1003597119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv1icGEB5c37KynVySctyqEg+tWzprTDkLlBCite2AhEOY4F5/rAODBfG4JyJ7TXHeg6JBrw+Ove+lL/IlFPAep4+vj1bub82hvxgJRIKv3x71MdLlIcBHDBm6KatNTIw=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:23.777485 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:44:23.777854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Mon Aug 29 22:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.77) !!! Aug 29 22:44:23.803465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-7885270a-225e-4fc2-b736-32284661dffe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for project 8ad722485ac34d1796f03003fbcde07a. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:23.809034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-7885270a-225e-4fc2-b736-32284661dffe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for user 8b46b3fa1df24c80ab7315c4ff44c064 and project 8ad722485ac34d1796f03003fbcde07a. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:23.850082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7885270a-225e-4fc2-b736-32284661dffe tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084403 Aug 29 22:44:23.851833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 255/518] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:44:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:23.993907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.033482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.040123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.044020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ba2ffa4f-90fc-418b-a3c5-c3f16673619a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.302928 Aug 29 22:44:24.051970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 264/519] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:24.508172 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.509125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.512466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:24.521652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.523212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.523766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.524011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.524962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.526467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.527511 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.528426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.532208 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.635470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Going to try to stop instance {{(pid=148457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:44:24.670874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.682769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-be898240-9557-4b92-bddb-fb23f951103b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1613 microversion: 2.1 time: 0.183180 Aug 29 22:44:24.683694 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 256/520] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1613 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:24.690374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.691237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.700103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.700838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.701380 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.702211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.703170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.703920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.750238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.751529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.752491 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.753489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lazy-loading 'fault' on Instance uuid 6bfb8e85-df7b-4481-9900-647fadc1bd32 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:24.785072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ac12c662-f86a-4091-9f13-c06f1f6343b3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action" status: 202 len: 0 microversion: 2.1 time: 0.276340 Aug 29 22:44:24.788480 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 265/521] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:44:24 2022] POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:24.811720 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd5423a-56bc-4eb2-8285-f32a236db67a", "name": "network-vif-deleted", "tag": "0aadfb69-64b9-4ed9-97ea-a90576f04ace"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:24.859733 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.863881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.866682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.867186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.873628 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6492e179-09aa-486b-9940-c1e5be302e9c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 200 len: 1309 microversion: 2.1 time: 0.187639 Aug 29 22:44:24.890943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 257/522] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:24.904147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.905142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.922604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] Creating event network-vif-deleted:0aadfb69-64b9-4ed9-97ea-a90576f04ace for instance 5dd5423a-56bc-4eb2-8285-f32a236db67a on hv-cinder-85427 Aug 29 22:44:24.935806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-028a4b4f-2520-4ed9-91f7-6a00623ffbff req-8da80d9b-6164-4d28-9a4e-c4190c484976 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142547 Aug 29 22:44:24.941501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.942166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.943277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 266/523] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:24.943914 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.950682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.951443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.952020 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.957843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.961074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.961257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:24.979562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.981241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.984506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.985567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.986582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.989094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.066598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.070244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.071141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.075767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lazy-loading 'fault' on Instance uuid f9762656-3203-41b2-9098-b02c212ac839 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:25.284457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3be77ead284ca7a85a57179e37c457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e66667ce1d4a8e87dc287d74ed6991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.299775 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ade9f6cd-9e3e-4230-a638-76e130a49508 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 200 len: 1304 microversion: 2.1 time: 0.404529 Aug 29 22:44:25.304928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 258/524] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 1304 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:25.309744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:25.310385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:25.331276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.331967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.332524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.337607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.340121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.343928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.396702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.413358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ee725f9c-0ee3-4c76-86b1-c7e4b0b086e3 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.466480 Aug 29 22:44:25.428009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 267/525] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:25.575288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.593762 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.598474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.601195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0edd0662-5ffa-4f91-b1b7-60a508274179 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.294793 Aug 29 22:44:25.604079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 259/526] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:25 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:25.710966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:25.713191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:25.727059 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.727838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.728713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.729972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.730814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.731583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.784398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.790647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.791566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.792352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'fault' on Instance uuid 5dd5423a-56bc-4eb2-8285-f32a236db67a {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:25.896365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:25.897119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 6bfb8e85-df7b-4481-9900-647fadc1bd32] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:25.906142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.906643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.907189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.908382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.912872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.918193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.919444 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.935926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ff668c8e-4ae1-4bb0-b7e9-eb754ef45455 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 200 len: 1331 microversion: 2.1 time: 0.231332 Aug 29 22:44:25.940534 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 268/527] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:25 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 1331 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:25.973079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] HTTP exception thrown: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Request method failure captured: Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 HTTP/1.1 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUDi_E135PrQsEqMC_YfAtjOo6IiHPttrt6P9-xhtWiwsP-HABTySua2PNn11VrlI4-9zcDvEHC66xZAH1ClRem6_JMagFP-pkVH3U8lo8cPahpuIFerXTpAsZUNRCJzfmRyP99cK7HEhTCogEBUqcUvXSyac8l3Wvk5ee2FN-gcK6Q Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 211213d0c20641adb48a3d39703f7532 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:44:25.976445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/211213d0c20641adb48a3d39703f7532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_211213d0c20641adb48a3d39703f7532", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/211213d0c20641adb48a3d39703f7532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/211213d0c20641adb48a3d39703f7532"}]}] Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 211213d0c20641adb48a3d39703f7532 Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-VolumesSnapshotTestJSON-1675240879-project Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 2d0e45a9ee9644f8b9eac57d9a14d14e Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-VolumesSnapshotTestJSON-1675240879-project Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. Aug 29 22:44:25.978067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '6bfb8e85-df7b-4481-9900-647fadc1bd32'} Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:25.979088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. Aug 29 22:44:25.982937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:25.984621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Returning 404 to user: Instance 6bfb8e85-df7b-4481-9900-647fadc1bd32 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:25.984621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-42e179a3-b204-40c9-9d8c-665230bb75d0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32" status: 404 len: 111 microversion: 2.1 time: 0.086596 Aug 29 22:44:25.984621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 260/528] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:25 2022] GET /compute/v2.1/servers/6bfb8e85-df7b-4481-9900-647fadc1bd32 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:44:26.329327 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:26.330365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] [instance: f9762656-3203-41b2-9098-b02c212ac839] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:26.341092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.341833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.342598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.343905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.344521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.345052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.377358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] HTTP exception thrown: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Request method failure captured: Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 HTTP/1.1 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUEFD47dqgKBPumhIk3cqwmJkwxyL2OYI9RRRQ1RrCrMk8r2nBf3dWnJRdAmPY6xkI6ROysa3E25kr7vadC6f4nFMV-c56XFiHYC0ANZkyeJj9r3d2z2TZ3RKiZ71LKTsyylsqbKOpuh0nJwD9jBnKXyIJP9xBBlJ8v298Ynf2BRmOg Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: a2e66667ce1d4a8e87dc287d74ed6991 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesNegativeTest-738402174 Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:44:26.379689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/a2e66667ce1d4a8e87dc287d74ed6991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_a2e66667ce1d4a8e87dc287d74ed6991", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a2e66667ce1d4a8e87dc287d74ed6991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a2e66667ce1d4a8e87dc287d74ed6991"}]}] Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesNegativeTest-738402174 Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: a2e66667ce1d4a8e87dc287d74ed6991 Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesNegativeTest-738402174 Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesNegativeTest-738402174-project Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 2d3be77ead284ca7a85a57179e37c457 Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesNegativeTest-738402174-project Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. Aug 29 22:44:26.382030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'f9762656-3203-41b2-9098-b02c212ac839'} Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:26.382964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. Aug 29 22:44:26.384465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:26.385824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] Returning 404 to user: Instance f9762656-3203-41b2-9098-b02c212ac839 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:26.385824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5d3e3db1-51da-4da7-a830-90719e1680b9 tempest-VolumesNegativeTest-738402174 tempest-VolumesNegativeTest-738402174-project] 10.222.0.77 "GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839" status: 404 len: 111 microversion: 2.1 time: 0.060943 Aug 29 22:44:26.387969 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 269/529] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/f9762656-3203-41b2-9098-b02c212ac839 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:44:26.435902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:26.436623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:26.448000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.448680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.449060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.449780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.450551 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.450672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.563984 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1919589761", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40dada36-2150-4300-9ee8-450a7585ae7c"}], "security_groups": [{"name": "tempest-securitygroup--1889588383"}], "key_name": "tempest-keypair-1003597119", "user_data": "}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:26.683135 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.693151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-82a73858-dd67-4600-b0f6-21f9895b486e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.261101 Aug 29 22:44:26.694443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 261/530] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:26.715530 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:26.716434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:26.723884 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.724649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.728251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.729292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.729949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.730572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.832236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] validate_networks() for [('40dada36-2150-4300-9ee8-450a7585ae7c', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:26.968685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.983680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.986783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.992982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5fd9f708-f923-4935-94e3-26f277fbce8b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.297231 Aug 29 22:44:27.006893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 262/531] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:27.012027 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.012794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.029262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.029822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.030313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.031168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.031647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.039346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.060162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a HTTP/1.1 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:44:27.061862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:44:27.063461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '5dd5423a-56bc-4eb2-8285-f32a236db67a'} Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:27.064321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:44:27.065718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:44:27.066996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:27.067744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9f862f8b-2556-4e3a-a357-f7ebb063e6eb tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 404 len: 111 microversion: 2.1 time: 0.072515 Aug 29 22:44:27.069611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 263/532] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:44:27.083644 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-91a9816a-ab60-456b-b11c-b6582bbcab39 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '.version_select at 0x7f5cf83ae820>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.116334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-91a9816a-ab60-456b-b11c-b6582bbcab39 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605846232" status: 202 len: 0 microversion: 2.1 time: 0.039544 Aug 29 22:44:27.117726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 264/533] 10.222.0.77 () {58 vars in 1221 bytes} [Mon Aug 29 22:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605846232 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:27.346941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:27.355528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:27.356057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:27.356460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:27.357073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:27.368494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.375266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.376113 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.377229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.377809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.378351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.416783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:27.429603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Getting quotas for user 8b46b3fa1df24c80ab7315c4ff44c064 and project 8ad722485ac34d1796f03003fbcde07a. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:27.453564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:27.457691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:27.549216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6b4f6496-65aa-4b18-aaa2-54a30af0a5d5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.989506 Aug 29 22:44:27.561649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-37d89a8f-c60f-4aca-b3df-7ad2ba71d6e1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.562837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-37d89a8f-c60f-4aca-b3df-7ad2ba71d6e1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.566545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 270/534] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:27.625381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-37d89a8f-c60f-4aca-b3df-7ad2ba71d6e1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:27.633249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-37d89a8f-c60f-4aca-b3df-7ad2ba71d6e1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1246 microversion: 2.1 time: 0.076198 Aug 29 22:44:27.635120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 265/535] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:27 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:27.725023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.727385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.740013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.741262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.742505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.744249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.745960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.745960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.997444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.007699 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e040be92-0dbb-441f-858a-e94d79d6e0c6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.290228 Aug 29 22:44:28.009678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 271/536] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:27 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:28.025203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.025966 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.033093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.033831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.034598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.036214 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.036853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.037448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.158739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.159264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.166058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.166585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.167081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.167855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.168319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.168797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.223830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.238383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.241950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.244747 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-28a96283-f69d-44d5-8117-6d86a6aa93d4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.224219 Aug 29 22:44:28.246507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 266/537] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:28 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:28.271244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'services' on Instance uuid e48a61e3-953a-41a2-a47f-96f40b362e3e {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:28.366443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-385a2d17-70ea-4abb-8f3a-01ca8520fa7c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments/109897a1-6d0a-43f5-82a0-0cfa18eb5bbb" status: 202 len: 0 microversion: 2.1 time: 0.211157 Aug 29 22:44:28.367568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 272/538] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:44:28 2022] DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments/109897a1-6d0a-43f5-82a0-0cfa18eb5bbb => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:44:28.375857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.378104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.384748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.385349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.385898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.386616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.387117 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.387542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.437218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-aad8bdc5-1243-4593-ba8b-17fe1c3133cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064989 Aug 29 22:44:28.438150 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 267/539] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:44:28 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:28.654461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.655196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.661903 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.662391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.662892 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.663599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.664057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.664485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.736660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.746427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d0741d10-0325-426c-9d7b-8d9c833fd555 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1250 microversion: 2.1 time: 0.096460 Aug 29 22:44:28.747740 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 273/540] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:28 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:29.034051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.034646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.043532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.044025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.044598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.045324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.045822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.046675 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.199873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.212121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-093845c3-b815-42f6-8bf0-807807d5a9f1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.182484 Aug 29 22:44:29.213029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 268/541] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:29.268536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.269151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.276251 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.276775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.277259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.277964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.278531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.278855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.454658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.457094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.470280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.471066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.471502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.472208 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.472826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.473696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.517558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3f32ba09-5c72-409c-8703-234274a2e67a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066684 Aug 29 22:44:29.517877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 269/542] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:29.520004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.535536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.538116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.540169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-725a7d12-b531-470f-a0d7-55b0f6c739c5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.275451 Aug 29 22:44:29.541080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 274/543] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:29.780859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.783278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.791684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.792515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.793249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.794508 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.795218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.795881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.861245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.870401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bff7c1c3-e4f0-4545-a306-4e2f92285e7d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1298 microversion: 2.1 time: 0.093893 Aug 29 22:44:29.871196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 270/544] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:30.129788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "name": "network-vif-plugged", "status": "completed", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:30.148199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.148686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.149338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.173582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] Creating event network-vif-plugged:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:44:30.197687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-ff613d34-299c-4a9a-b532-83123a2caf3d req-2722617e-4a21-475f-b767-9f88d1feee5c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071914 Aug 29 22:44:30.201992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 275/545] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:30.236218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.237237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.247224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.247748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.248141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.249046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.250933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.250933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.415284 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.424310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-39937808-66b9-404e-b873-d13b46d097d5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.193875 Aug 29 22:44:30.424899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 271/546] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:30.539558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.544114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.553192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.553627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.554413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.555470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.556013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.556512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.582087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.583010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.593278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.593883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.594358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.595113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.595888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.596480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.602685 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1f69550a-506f-4905-89b2-8815b181ee4e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073210 Aug 29 22:44:30.603924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 276/547] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:44:30.687693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.688422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.696322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.696871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.697376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.698687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.699048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.699747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.727938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:44:30.756054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:30.761339 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.771552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.773671 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.774932 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-96ca81d1-2391-40d3-be28-c0d50e2efd20 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.202671 Aug 29 22:44:30.776155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 272/548] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:30.827709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-be3ce42e-52da-4d21-8b06-9ba1de6dd24a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 204 len: 0 microversion: 2.1 time: 0.142315 Aug 29 22:44:30.827709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 277/549] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:44:30 2022] DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:44:30.836882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.837482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.859903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.860235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.861012 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.862301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.863198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.863995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.896092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.897617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.904122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.904619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.905090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.905800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.906257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.906712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.996275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.004393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ffc39a33-0165-4bf6-9331-973d41805012 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1306 microversion: 2.1 time: 0.112535 Aug 29 22:44:31.004973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 278/550] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:31.043360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.051116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-53bba962-8ce9-457c-8fce-54552f8d1316 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1682 microversion: 2.1 time: 0.218877 Aug 29 22:44:31.051683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 273/551] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:31.453106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.453776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.460360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.460898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.461334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.462039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.462496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.462947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.618857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.627505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-578b4cb2-28d1-46fd-a80a-f960eb22ac3d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.178135 Aug 29 22:44:31.628222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 279/552] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:31.801066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.802524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.810219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.810703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.811356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.812360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.812964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.813537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.026599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.027577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.029435 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.034867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.035656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.036262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.037139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.037812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.038223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.040604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.042131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.044235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f4577be8-775f-474f-b1cb-85591a6aa950 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.248496 Aug 29 22:44:32.044835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 274/553] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:32.076301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.077794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.089438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.090316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.091127 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.092368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.093202 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.094259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.123043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.133409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5859f5eb-24c9-4b23-befa-4a0911b1006e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1306 microversion: 2.1 time: 0.111721 Aug 29 22:44:32.134827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 280/554] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:32.290300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.306781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5d8e6be1-305e-4dfd-b4c6-27a9060432d4 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1682 microversion: 2.1 time: 0.238099 Aug 29 22:44:32.307866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 275/555] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:32.651078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.651678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.658383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.658906 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.659340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.660040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.660491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.660905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.796121 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.804042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2b727f39-1a20-48eb-8f5a-9a91a5f435f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.157358 Aug 29 22:44:32.804610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 281/556] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:33.066316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.066955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.073872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.074350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.074814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.075577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.075986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.076406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.155396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.156013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.163600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.164089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.164522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.165225 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.165679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.166108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.214263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.223450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.224884 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.226027 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cbece205-30ed-4e0d-aff7-570fc0129d94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.163616 Aug 29 22:44:33.227114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 276/557] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:33.234980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.243827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fc16dd5a-590b-49ed-841f-9e9c4fedffa0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1316 microversion: 2.1 time: 0.092218 Aug 29 22:44:33.244401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 282/558] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:33.336641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.337783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.348477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.349343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.349907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.350629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.351126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.351565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.483361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.486840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:33.492733 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-93e120cf-2489-4bbe-816e-57cb35c7b01c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1682 microversion: 2.1 time: 0.163437 Aug 29 22:44:33.493336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 277/559] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:33.824530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.825181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.831582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.832058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.832487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.833167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.833616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.834033 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.971140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.982998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2f46f1dd-f8bd-4cdd-84e7-f4e22a957972 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.162155 Aug 29 22:44:33.983584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 283/560] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:34.249895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.250622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.257852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.258333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.258772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.259472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.260035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.260467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.273830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.275183 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.284244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.285101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.286256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.287020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.287926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.288360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.384932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.394134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9b50c3e6-83c4-470b-9e90-fd1117201139 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1304 microversion: 2.1 time: 0.128156 Aug 29 22:44:34.395647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 284/561] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:34.437520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.446663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.448122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.450882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-947c56c4-920e-48e9-98f3-c4c04e413b9a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.205005 Aug 29 22:44:34.453142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 278/562] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:34.514325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.514986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.522826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.523935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.524480 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.528864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.528864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.528864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.672661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.682459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-964c26c4-2d0a-4794-b7c7-67682a6b5a10 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1682 microversion: 2.1 time: 0.172731 Aug 29 22:44:34.683379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 285/563] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:35.009829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.011690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.028627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.029815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.030589 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.032057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.032906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.033733 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.206760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1260071469", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "networks": [{"uuid": "231f0f42-8ad1-4fa2-99bc-8a96caeeee6e"}]}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:35.213243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.223042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-97398128-2e64-418e-a94e-3c7ac6789acd tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.220903 Aug 29 22:44:35.223816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 279/564] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:35.269822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] validate_networks() for [('231f0f42-8ad1-4fa2-99bc-8a96caeeee6e', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:35.417484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.419363 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.425898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.426403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.427001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.427736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.428696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.429293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.717603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.726445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-73c41bb0-0753-455d-9faf-69645ddbffd5 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.313119 Aug 29 22:44:35.727147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 280/565] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:35.741936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.742552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.749199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.749927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.750373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.751567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.751567 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.751983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.980710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.990524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.992603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.993857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6dde481e-c3c0-4e4c-9ab0-abe2f52d3474 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.256605 Aug 29 22:44:36.006755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 281/566] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:36.006755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.006755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.008289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.008882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.009390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.010163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.010690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.011279 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.041849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:36.042718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:36.043233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:36.043646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:36.044062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:36.058564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.059372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.059822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.060921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.061391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.061823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.081485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Getting quotas for project 211213d0c20641adb48a3d39703f7532. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:36.086079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Getting quotas for user 2d0e45a9ee9644f8b9eac57d9a14d14e and project 211213d0c20641adb48a3d39703f7532. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:36.099223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:36.102525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:36.159159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-74b5742e-b961-4e63-ba4f-7c0580a34fdb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956257 Aug 29 22:44:36.160498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 286/567] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:36.164958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:36.170907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:36.177833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.178880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.179317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.183908 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.193033 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] Creating event network-changed:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:44:36.193477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8b0f261f-0a77-4285-8580-a863938838b7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1682 microversion: 2.1 time: 0.197403 Aug 29 22:44:36.194841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 282/568] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:36.202319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-76f9dcfe-03ae-4271-97f9-5e4b0b70e55c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.203186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-76f9dcfe-03ae-4271-97f9-5e4b0b70e55c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.212381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-f1a2647f-95ea-4e76-aa82-295bf6ee71e8 req-06ecfdf7-3b0a-4091-9be1-55b96ee0c994 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050030 Aug 29 22:44:36.213296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 287/569] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:36.246432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.247330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.254843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.255478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.256230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.257718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.258402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.259127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.274430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-76f9dcfe-03ae-4271-97f9-5e4b0b70e55c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.283971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-76f9dcfe-03ae-4271-97f9-5e4b0b70e55c tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1219 microversion: 2.1 time: 0.088000 Aug 29 22:44:36.285164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 283/570] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:36.436105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.445598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d38cbc41-f78d-431b-98f4-491b7fdc207b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.203988 Aug 29 22:44:36.446803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 288/571] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:36.749091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.750384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.757901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.758674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.759148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.760179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.760978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.761643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.929163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.953769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a0f273f6-66aa-43f4-bc05-747d4eb3ea2f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.209122 Aug 29 22:44:36.967472 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 284/572] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.020573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.021107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.036078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.037349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.039588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.040539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.043333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.043955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.210031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.219414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.220106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.221739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.223611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.224941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-de17a2ee-fe0d-46f1-9472-3687a55f16c6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1807 microversion: 2.20 time: 0.208871 Aug 29 22:44:37.225952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 289/573] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:37.230058 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.230816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.231569 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.232316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.233245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.233830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.283766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.284502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.285084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.285653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'fault' on Instance uuid e48a61e3-953a-41a2-a47f-96f40b362e3e {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:37.308517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.309137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.319039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.319541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.319976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.320678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.326325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.328050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.337702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.346403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8383684a-3ba8-4a38-a8dc-f5a3c859461b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1332 microversion: 2.1 time: 0.132161 Aug 29 22:44:37.347315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 285/574] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:37.408386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.416932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a7e28228-3a28-4ce5-9407-27437777de63 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1215 microversion: 2.1 time: 0.112301 Aug 29 22:44:37.417772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 290/575] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.466854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.467466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.473898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.474388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.475390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.476091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.476732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.477157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.640574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.651229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3008e798-428b-43e6-9bf2-66eb1987a8be tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.188087 Aug 29 22:44:37.653016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 286/576] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.977409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.978058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.985016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.985516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.985953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.986660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.987175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.987687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.206298 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.221129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a9c72f4a-3ee4-477e-b49b-37db39f37fc0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.247382 Aug 29 22:44:38.234897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 291/577] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:38.251988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.252688 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.255338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:38.261660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.262236 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.262690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.264276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.265261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.265843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.369648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.370539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.382664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.383207 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.383646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.384369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.384899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.388267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.441118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.441882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.442338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.442823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'fault' on Instance uuid e48a61e3-953a-41a2-a47f-96f40b362e3e {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:38.452130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.463233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.465315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.466602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0563be60-093c-4e78-83af-acc3c14af40d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1794 microversion: 2.20 time: 0.220415 Aug 29 22:44:38.467814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 287/578] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1794 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:38.473155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.474121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.482241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.483148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.483837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.484761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.485417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.486149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.498514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.509208 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9051cc90-3533-4d96-99e8-3001b75c4558 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 200 len: 1332 microversion: 2.1 time: 0.144197 Aug 29 22:44:38.511368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 292/579] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 1332 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:38.514854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48a61e3-953a-41a2-a47f-96f40b362e3e", "name": "network-vif-deleted", "tag": "f190fef4-1aa0-400e-be49-90c39442815f"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:38.525414 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.525895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.526445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.539263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] Creating event network-vif-deleted:f190fef4-1aa0-400e-be49-90c39442815f for instance e48a61e3-953a-41a2-a47f-96f40b362e3e on hv-cinder-85427 Aug 29 22:44:38.545045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-b39d8104-1351-4e00-8fa6-b54e6f3329c8 req-eff6d8bc-790a-4b1c-9621-75c4404b4622 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Aug 29 22:44:38.545873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 293/580] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:38.568739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.576443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-85cc5e3f-479e-4c72-b1b5-48dac5216d46 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1271 microversion: 2.1 time: 0.107164 Aug 29 22:44:38.576999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 288/581] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:38.674579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.675311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.681604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.682083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.682526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.683258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.683719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.684171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.840201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.848283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5f7f9103-54ad-49a8-b1fe-193a754fd1cf tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.177866 Aug 29 22:44:38.848777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 294/582] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:39.242672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.243719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.250710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.251701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.252249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.253649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.254181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.254862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.393175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.401556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-60fed1d9-f81a-422c-abc1-30e3eed9bb3c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.163997 Aug 29 22:44:39.402218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 289/583] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:39.531700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.532296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.538938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.539430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.539861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.540557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.541010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.541426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.545723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:39.557361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e HTTP/1.1 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:44:39.559205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:44:39.560916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'e48a61e3-953a-41a2-a47f-96f40b362e3e'} Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:39.561717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:44:39.563004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:44:39.564112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:39.564112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-15e38f61-c376-41a4-9d6b-a1c5639bf347 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 404 len: 111 microversion: 2.1 time: 0.032922 Aug 29 22:44:39.564112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 295/584] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:44:39.570199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c258848a-dead-4d93-bf54-e340e3704c35 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '.version_select at 0x7f5cf83ae820>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.590942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c258848a-dead-4d93-bf54-e340e3704c35 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476472244" status: 202 len: 0 microversion: 2.1 time: 0.025008 Aug 29 22:44:39.591690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 290/585] 10.222.0.77 () {58 vars in 1221 bytes} [Mon Aug 29 22:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476472244 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:39.599419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.600727 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.609754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.610389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.611092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.611858 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.612517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.613044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.696615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.705495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d1be369e-3c51-4ad7-b916-7a9824c0d35b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1277 microversion: 2.1 time: 0.110431 Aug 29 22:44:39.706073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 296/586] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:39.869968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.870883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.877172 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.877846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.878447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.879381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.879998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.880584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.177585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.188969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-57efb7df-47a0-4588-9992-fbfae27979c0 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1674 microversion: 2.1 time: 0.323279 Aug 29 22:44:40.189483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 291/587] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:40.354750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-932facaa-3f70-4db6-a64e-be9410943398 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: .version_select at 0x7f5cf6d57c10>, body: {"keypair": {"name": "tempest-keypair-52665640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfFMIbQoyBIhbdU7USYq0fdquI6XBZtdlwf3883oTwX/+LXeJ94+I6QgYibFJALRoyLa9IFLKYcNsudfkAyU4TsFKHVg/NbZEkt05Vov1sLkhd0fjnAqAZXmaF0Dsd8+Q=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:40.371346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-932facaa-3f70-4db6-a64e-be9410943398 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:40.375336 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-932facaa-3f70-4db6-a64e-be9410943398 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:40.399837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-932facaa-3f70-4db6-a64e-be9410943398 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049042 Aug 29 22:44:40.400435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 297/588] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:44:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:40.424677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:40.425291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:40.433795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.435106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.436428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.438488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.439262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.439959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.672830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.688948 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1c6dae62-2846-471b-a332-f73ac5c7767e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.269232 Aug 29 22:44:40.689538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 292/589] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:40 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:40.733221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:40.736157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:40.736687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e273fd-0a5a-428b-8dee-ebcba50ae282", "tag": "a43c3931-b6ac-4aa9-85b2-68b3b73169c4"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:40.745223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.745725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.746166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.746993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.747519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.748260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.749080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.749629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.750381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.765074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] Creating event network-changed:a43c3931-b6ac-4aa9-85b2-68b3b73169c4 for instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 on hv-cinder-85427 Aug 29 22:44:40.770653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-d81820cb-38d6-4637-97ce-d260d9332eab req-4e645403-f4f2-44b7-9e1e-4911e979632d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038328 Aug 29 22:44:40.771878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 293/590] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:40.899813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.907805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fcb0e369-f5c5-4d9d-b8be-a52c3bef7c0b tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.184516 Aug 29 22:44:40.908461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 298/591] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:40 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:41.210490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.211442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.218052 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.218902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.219421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.220197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.220724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.221278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.432035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.440128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8aa29c7a-77d9-428a-8ec5-f1e7aa38e25a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1651 microversion: 2.1 time: 0.234409 Aug 29 22:44:41.440692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 294/592] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1651 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:41.461937 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:41.468114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.468870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.469305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.502212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Going to try to start instance {{(pid=148457) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:44:41.546373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1435338b-a23b-49c8-b079-b7936cdbaf55 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action" status: 202 len: 0 microversion: 2.1 time: 0.088834 Aug 29 22:44:41.547051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 299/593] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:44:41 2022] POST /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:41.555122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.555737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.561716 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.562204 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.562642 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.563369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.563826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.564250 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.714926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.715865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.723324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.723805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.724238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.725193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.725649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.726063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.832862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.840877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-97a93ca9-5f49-43c1-9bdb-ff617a955088 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1660 microversion: 2.1 time: 0.289576 Aug 29 22:44:41.841456 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 295/594] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1660 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:41.930264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.931689 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.941759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.943021 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.943751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.944765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.945347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.946177 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.976102 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.991025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2acc6bd3-6b27-4b08-9014-47c923e0efee tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.279575 Aug 29 22:44:41.994021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 300/595] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:42.143579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "name": "network-vif-plugged", "status": "completed", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:42.156734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.157642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.158293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.164080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:42.172794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:42.179044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c133244e-61ff-49d9-a1e0-8dfbf86588c6 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.254245 Aug 29 22:44:42.195114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 296/596] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:42.201250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] Creating event network-vif-plugged:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:44:42.207432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-d5bf5d1d-a81c-4078-86b5-1f87cdea2f32 req-bc4b97c8-f90c-4e62-bae2-a481ac119772 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071084 Aug 29 22:44:42.208655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 301/597] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:42.282201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1820790527", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4fab7c6-be28-40e9-82ea-67b0ac291d9e"}], "security_groups": [{"name": "tempest-securitygroup--2132766052"}], "key_name": "tempest-keypair-52665640", "user_data": "}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:42.461986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] validate_networks() for [('c4fab7c6-be28-40e9-82ea-67b0ac291d9e', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:42.864587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.865343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:42.865490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:42.866145 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:42.866873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:42.867522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:42.868163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:42.871971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.872529 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.873171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.874011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.874455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.875028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.878311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.878830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.879267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.880001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.880452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.880915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.899730 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:42.904254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:42.915924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:42.918448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:42.976315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-392079f9-4433-4d2e-8fc3-48de011291a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700943 Aug 29 22:44:42.977336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 297/598] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:42.990381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-411fe2bb-4ab1-4f45-9fd6-b5491adcff08 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.991419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-411fe2bb-4ab1-4f45-9fd6-b5491adcff08 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.024426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.035614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fb5ee9a9-c500-4959-bb44-7675e080498a tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1660 microversion: 2.1 time: 0.175466 Aug 29 22:44:43.036202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 302/599] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1660 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:43.041854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:43.042709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.052551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.053121 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.053708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.054448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.054942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.055377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.073850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-411fe2bb-4ab1-4f45-9fd6-b5491adcff08 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.081449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-411fe2bb-4ab1-4f45-9fd6-b5491adcff08 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1240 microversion: 2.1 time: 0.097130 Aug 29 22:44:43.082297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 298/600] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:43.201461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:43.202037 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.206304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.208585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.209239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.209935 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.210652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.211185 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.211618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.215499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-12e61364-3ca2-4e35-9e8c-318356a1b67c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1372 microversion: 2.1 time: 0.177423 Aug 29 22:44:43.216173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 303/601] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:43 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:43.367248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.377442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ede0a6de-a3b7-4549-a020-520cf7e77beb tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.179992 Aug 29 22:44:43.378514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 299/602] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:43 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:44.061119 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.062210 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.069993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.070472 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.070949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.071653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.072114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.072537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.113946 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.118602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.152815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.154703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.155560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.158624 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.159316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.160011 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.270155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.281538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6f0e755a-d14a-4d5a-b75d-63645e89f3d1 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1292 microversion: 2.1 time: 0.181401 Aug 29 22:44:44.296229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 300/603] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:44.301946 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.303213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.307034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.309881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.310357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.310817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.311896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.312102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.312986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.317744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0dc3f624-a109-4bbc-b30f-3c8587edab6d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1660 microversion: 2.1 time: 0.263778 Aug 29 22:44:44.319199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 304/604] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1660 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:44.399022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.400489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.409134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.409604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.410040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.410848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.411309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.411735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.469867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.477849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7084a08c-37c2-4fec-810f-c9f725fca717 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1565 microversion: 2.1 time: 0.180520 Aug 29 22:44:44.478415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 301/605] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:44.499404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.500007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.508358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.508358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.508358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.509450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.509957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.510056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.595378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.604416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-98c1bcd0-0fb0-41bf-a8a7-9ca153be11ff tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.209296 Aug 29 22:44:44.613526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 305/606] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:44.617701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4b68d296-f038-44ec-ab97-859e7f903c69 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122321 Aug 29 22:44:44.618640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 302/607] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:45.303563 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:45.304201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:45.310590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.311112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.311547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.312278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.312733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.313160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.344890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:45.345497 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:45.352282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.352768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.353202 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.354103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.354605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.355205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.392635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.401144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-474f954c-4758-4530-957b-3553439afc56 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1292 microversion: 2.1 time: 0.101879 Aug 29 22:44:45.401988 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 306/608] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:45 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:45.626906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.627087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:45.627717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:45.636189 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.636939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.637455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.638353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.638926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.639428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.644703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fc60e5eb-575c-47e7-a085-396db4770e4e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1664 microversion: 2.1 time: 0.304355 Aug 29 22:44:45.645432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 303/609] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:45 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1664 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:45.885527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.895504 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-598d8b47-8ff9-4372-abee-ab0a1addb0b7 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.272346 Aug 29 22:44:45.910200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 307/610] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:45 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:46.087032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:46.106392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.107274 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.108258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.124143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] Creating event network-changed:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:44:46.129933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-f9628b1e-ab7e-4d3b-a19a-1d0b41cfcdfd req-2aa15277-984c-4e9a-a0bf-03faa105a8d7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056810 Aug 29 22:44:46.131992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 304/611] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:46.208471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e273fd-0a5a-428b-8dee-ebcba50ae282", "name": "network-vif-plugged", "status": "completed", "tag": "a43c3931-b6ac-4aa9-85b2-68b3b73169c4"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:46.217974 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:46.221850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.222398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.223006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.235926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] Creating event network-vif-plugged:a43c3931-b6ac-4aa9-85b2-68b3b73169c4 for instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 on hv-cinder-85427 Aug 29 22:44:46.241186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-f35fb075-48bd-4c7b-9784-edb6cad960e4 req-cd4ad806-ddff-48f2-82a5-584847b52a2f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037410 Aug 29 22:44:46.241876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 308/612] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:46.426166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:46.426909 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:46.441928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.442698 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.443900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.445234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.447826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.448478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.654056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:46.662153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-65ff06dc-7493-415f-a1ea-653d07811367 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.241960 Aug 29 22:44:46.662643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 305/613] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:46 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:46.921370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:46.922867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:46.931430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.932204 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.932823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.933834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.934364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.934946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.098281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:47.106618 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f9edc28f-5409-4f5f-8879-7d9901f0853e tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.192256 Aug 29 22:44:47.107491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 309/614] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:46 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:47.688672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:47.689296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:47.695458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.695921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.696353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.697045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.697499 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.698277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.840278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:47.841804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6", "tag": "5cad65a1-8559-48f6-bc5a-957d654be244"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:47.852069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.852312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-22629525-014c-48b4-bc44-dc8dd717384c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.170390 Aug 29 22:44:47.852542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.852964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.866623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 306/615] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:47 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:47.875101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] Creating event network-changed:5cad65a1-8559-48f6-bc5a-957d654be244 for instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 on hv-cinder-85427 Aug 29 22:44:47.880005 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-46c39597-1124-486a-adc5-48635760b7c4 req-015d768b-6033-4c06-8429-ce5f57db2070 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041915 Aug 29 22:44:47.881255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 310/616] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:48.127693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:48.128297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:48.134967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.135447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.135880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.136569 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.137011 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.137429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.269438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:48.277310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2f724f14-58ea-4ea6-8873-59777eadf05f tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1319 microversion: 2.1 time: 0.153415 Aug 29 22:44:48.277897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 307/617] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:48 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:48.874473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:48.875231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:48.881408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.881884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.882309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.883039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.883489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.883904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.025910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:49.034378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ed067e55-53be-4c1b-a3b9-15d3e3508d2e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.164714 Aug 29 22:44:49.034977 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 311/618] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:48 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:49.297571 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:49.298114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:49.304507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.304980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.305405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.306086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.306529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.307143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.438072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:49.446392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f7365346-e053-4b45-a973-c3ef22ce7481 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1508 microversion: 2.1 time: 0.152711 Aug 29 22:44:49.447001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 308/619] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:49 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:49.467204 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c37aa638-deda-4f06-8d56-7cd78bde77da", "device": "/dev/sdb"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:49.470246 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:49.476614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.477097 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.477539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.478266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.478765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.479193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.055679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:50.056287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:50.062443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.062972 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.063409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.064103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.064557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.064983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.199446 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:50.207349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0afe4f7a-dc51-4bfe-9734-2292fdeb7278 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.155624 Aug 29 22:44:50.207921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 309/620] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:50 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:50.289497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c1f9e624-1ca8-4858-8155-ae7f24558640 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "POST /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826103 Aug 29 22:44:50.290182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 312/621] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:44:49 2022] POST /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:51.229323 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:51.229951 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:51.236495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.236975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.237407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.238098 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.238548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.238994 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.370030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:51.378479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-66ad2e37-ea6d-4724-8dfc-81c1f7a24c09 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.152892 Aug 29 22:44:51.379090 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 310/622] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:51 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:52.397791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=16 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:52.402415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:52.403158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:52.409655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:52.410136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:52.410572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:52.411296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:52.412259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:52.412682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:52.417132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:52.556958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:52.564755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-25dbc9fe-507b-4712-9592-805c0b59a43e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.168430 Aug 29 22:44:52.565329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 313/623] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:52 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:53.586688 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:53.587326 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:53.589819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:53.590622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=16 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:53.596791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:53.597288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:53.597725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:53.598421 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:53.598908 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:53.599917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:53.731065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:53.738828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4a361eac-40f3-4fc5-bd13-004b2bab423e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.156478 Aug 29 22:44:53.739392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 311/624] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:53 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:54.135326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6", "name": "network-vif-plugged", "status": "completed", "tag": "5cad65a1-8559-48f6-bc5a-957d654be244"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:54.146637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.147156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.147588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.159387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] Creating event network-vif-plugged:5cad65a1-8559-48f6-bc5a-957d654be244 for instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 on hv-cinder-85427 Aug 29 22:44:54.164163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-93c90156-5c16-426c-b66f-b54fb93820ed req-b2f8a3d2-b2b0-4e4a-bd41-5688731af9ea service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Aug 29 22:44:54.164759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 314/625] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:54.760148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:54.760787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:54.767207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.767683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.768143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.768857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.769312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.769727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.898658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:54.906271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e667c366-9389-49b2-b752-0682fd503de6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.149984 Aug 29 22:44:54.906854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 312/626] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:54 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:55.929103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:55.929802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:55.936024 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:55.936507 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:55.936982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:55.937673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:55.938127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:55.938552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:56.066013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:56.074391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c7a29bb7-951d-4753-a45c-f9d4c5ba3fc9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1366 microversion: 2.1 time: 0.150120 Aug 29 22:44:56.074993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 315/627] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:55 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:57.095964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:57.096569 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:57.102787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.103417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.103872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.104572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.105028 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.105453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.237296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:57.245600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-182a54b7-aad6-430f-afee-597a53e05520 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1556 microversion: 2.1 time: 0.153785 Aug 29 22:44:57.246168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 313/628] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:57 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:57.266125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:57.266673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:57.273250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.273734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.274171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.274925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.275384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.275820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.353899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c140338a-85de-402b-80df-c2f25fefb7a7 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091422 Aug 29 22:44:57.354525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 316/629] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:44:57 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:58.343082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6", "tag": "5cad65a1-8559-48f6-bc5a-957d654be244"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:58.353620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:58.354182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:58.354672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:58.368701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] Creating event network-changed:5cad65a1-8559-48f6-bc5a-957d654be244 for instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 on hv-cinder-85427 Aug 29 22:44:58.374905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-48a7e3e2-219a-4a72-9d2f-574ddda6e59b req-c618aa04-d110-4dd1-8657-f08e30dd9ea3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Aug 29 22:44:58.375881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 314/630] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:09.664000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:09.664806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=16 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:09.669403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:09.669924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:09.677418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:09.677892 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:09.678326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:09.679079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:09.679559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:09.679986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:09.760107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lazy-loading 'services' on Instance uuid 22e273fd-0a5a-428b-8dee-ebcba50ae282 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:09.834931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-05c7de8e-41e1-466f-83dd-1fb0d3926462 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "DELETE /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282/os-volume_attachments/c37aa638-deda-4f06-8d56-7cd78bde77da" status: 202 len: 0 microversion: 2.1 time: 0.172204 Aug 29 22:45:09.835523 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 317/631] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:45:09 2022] DELETE /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282/os-volume_attachments/c37aa638-deda-4f06-8d56-7cd78bde77da => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:45:10.959230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:10.959974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=88 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:10.964390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:10.964977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:10.972649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.973133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.973592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.974286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.974751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.975187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.001501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:45:11.081433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e4bd5eef-2fb3-4919-a4a3-4b56ae7b2abd tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "DELETE /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 204 len: 0 microversion: 2.1 time: 0.124078 Aug 29 22:45:11.082307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 315/632] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:45:10 2022] DELETE /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:45:11.092610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:11.093576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:11.099735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.100217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.100654 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.101347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.101804 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.102230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.233337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:11.241164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ae80279f-80bc-4158-98e4-bc02cc430684 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1514 microversion: 2.1 time: 0.153248 Aug 29 22:45:11.241727 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 318/633] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:11 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:12.262829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:12.263552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:12.270138 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.271286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.271959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.272657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.273114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.273538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.413641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:12.422009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9265b758-405e-40d8-b586-01b821b3e649 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1514 microversion: 2.1 time: 0.163397 Aug 29 22:45:12.422931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 316/634] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:12 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:13.444663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:13.445311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:13.451966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.452384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.452818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.453524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.453977 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.454403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.589242 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0e45a9ee9644f8b9eac57d9a14d14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211213d0c20641adb48a3d39703f7532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:13.597589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f019ed81-ebe5-4458-bdf9-54693d79f0a0 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 200 len: 1514 microversion: 2.1 time: 0.157297 Aug 29 22:45:13.598347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 319/635] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:13 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:13.619803 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e273fd-0a5a-428b-8dee-ebcba50ae282", "name": "network-vif-deleted", "tag": "a43c3931-b6ac-4aa9-85b2-68b3b73169c4"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:13.631059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.631900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.632403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.645887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] Creating event network-vif-deleted:a43c3931-b6ac-4aa9-85b2-68b3b73169c4 for instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 on hv-cinder-85427 Aug 29 22:45:13.651044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-192a4c9c-a5d4-4d66-80e8-80244d1e1a12 req-1ccbbb33-9568-4fe3-95ae-44386074e92f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Aug 29 22:45:13.651640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 317/636] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:14.619177 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:14.619782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] [instance: 22e273fd-0a5a-428b-8dee-ebcba50ae282] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:14.626199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:14.626682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:14.627220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:14.627911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:14.628365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:14.628785 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:14.642308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] HTTP exception thrown: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Request method failure captured: Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 HTTP/1.1 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUDi_E135PrQsEqMC_YfAtjOo6IiHPttrt6P9-xhtWiwsP-HABTySua2PNn11VrlI4-9zcDvEHC66xZAH1ClRem6_JMagFP-pkVH3U8lo8cPahpuIFerXTpAsZUNRCJzfmRyP99cK7HEhTCogEBUqcUvXSyac8l3Wvk5ee2FN-gcK6Q Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 211213d0c20641adb48a3d39703f7532 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:45:14.643962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/211213d0c20641adb48a3d39703f7532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_211213d0c20641adb48a3d39703f7532", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/211213d0c20641adb48a3d39703f7532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/211213d0c20641adb48a3d39703f7532"}]}] Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 211213d0c20641adb48a3d39703f7532 Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1675240879 Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesSnapshotTestJSON-1675240879-project Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 2d0e45a9ee9644f8b9eac57d9a14d14e Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesSnapshotTestJSON-1675240879-project Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. Aug 29 22:45:14.646070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '22e273fd-0a5a-428b-8dee-ebcba50ae282'} Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:14.646875 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. Aug 29 22:45:14.648476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:14.649725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] Returning 404 to user: Instance 22e273fd-0a5a-428b-8dee-ebcba50ae282 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:14.649725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-87256ae9-035b-41ed-aa38-e05cccfc4b61 tempest-VolumesSnapshotTestJSON-1675240879 tempest-VolumesSnapshotTestJSON-1675240879-project] 10.222.0.77 "GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282" status: 404 len: 111 microversion: 2.1 time: 0.030278 Aug 29 22:45:14.649725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 320/637] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:14 2022] GET /compute/v2.1/servers/22e273fd-0a5a-428b-8dee-ebcba50ae282 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:27.676827 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.677495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.681952 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:27.682535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:27.689937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.690417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.690879 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.691568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.692016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.692435 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.722427 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-422ded9d-51b9-442d-a0a2-cc1f0d7677f2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments/826207fb-19b1-4405-9df0-ee51b622dd00" status: 200 len: 194 microversion: 2.20 time: 0.047818 Aug 29 22:45:27.723581 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 318/638] 10.222.0.77 () {60 vars in 1454 bytes} [Mon Aug 29 22:45:27 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments/826207fb-19b1-4405-9df0-ee51b622dd00 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:45:27.798428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:27.799011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:27.801199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=8 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.801856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.807615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.808097 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.808524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.809210 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.809655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.810068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.901770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'services' on Instance uuid 85dd30e7-c635-4bcd-98e3-8aa61c52d30e {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:27.974319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d14c1aad-f944-4c57-92e3-e216316de5e8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments/826207fb-19b1-4405-9df0-ee51b622dd00" status: 202 len: 0 microversion: 2.20 time: 0.179118 Aug 29 22:45:27.975027 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 321/639] 10.222.0.77 () {60 vars in 1457 bytes} [Mon Aug 29 22:45:27 2022] DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments/826207fb-19b1-4405-9df0-ee51b622dd00 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:45:27.983317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:27.985481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:27.991613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.992188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.992627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.993529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:27.993983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:27.994521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:28.027783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-11125e46-fac6-4702-98d4-bc216892ac24 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048259 Aug 29 22:45:28.028352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 319/640] 10.222.0.77 () {60 vars in 1343 bytes} [Mon Aug 29 22:45:27 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:45:29.042187 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:29.044628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:29.050781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.051933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.052362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.053053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.053495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.053914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.083021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0bba6c12-2364-4d87-a8fb-9d529d1a2c65 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045750 Aug 29 22:45:29.083567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 322/641] 10.222.0.77 () {60 vars in 1343 bytes} [Mon Aug 29 22:45:29 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:29.144518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:29.145065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:29.151450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.151924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.152356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.153815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.153815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.154031 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.179829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:45:29.256122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-24d5e54a-0d92-45d6-b461-bd05548297e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 204 len: 0 microversion: 2.20 time: 0.115177 Aug 29 22:45:29.256700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 320/642] 10.222.0.77 () {60 vars in 1280 bytes} [Mon Aug 29 22:45:29 2022] DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:45:29.265255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:29.265885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:29.272564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.273051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.273492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.274193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.274653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.275385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.407473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:29.415727 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:29.417164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:29.418285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-adcf9e52-dc3e-4470-9c85-d3e2bc581fa3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.157049 Aug 29 22:45:29.418862 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 323/643] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:29 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:30.442186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:30.442938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:30.449344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:30.449820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:30.450267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:30.450986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:30.451460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:30.451870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:30.586287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:30.595022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:30.596434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:30.597633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3ae84eae-9ffd-4e51-975f-9c13ee9a8fa4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.159674 Aug 29 22:45:30.598746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 321/644] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:30 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:31.624023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:31.624693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:31.632294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:31.632773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:31.633260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:31.633950 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:31.634397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:31.634841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:31.769881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:31.778362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:31.779860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:31.781053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-457b668b-f8cc-4c13-a9a2-92e37f0cfae8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1722 microversion: 2.20 time: 0.161433 Aug 29 22:45:31.781619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 324/645] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:31 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:32.135184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85dd30e7-c635-4bcd-98e3-8aa61c52d30e", "name": "network-vif-deleted", "tag": "20694cdd-bf51-4e4c-8264-c22bdfb04cb9"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:32.146005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.146661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.147125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.162662 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] Creating event network-vif-deleted:20694cdd-bf51-4e4c-8264-c22bdfb04cb9 for instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e on hv-cinder-85427 Aug 29 22:45:32.168304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-0fa32420-2eed-468c-9c59-02cbf9fe6b70 req-bb228718-7c80-4382-977e-bd0737a8546c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037213 Aug 29 22:45:32.169246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 322/646] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:32.804452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:32.805047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:32.811559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.812050 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.812493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.813202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.813660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.814089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.848886 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.849374 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.849808 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.850262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'fault' on Instance uuid 85dd30e7-c635-4bcd-98e3-8aa61c52d30e {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:32.900735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:32.914273 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:32.915791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:32.916980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ab6525c4-d6a2-4169-8c50-bc1d7445b7a8 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 200 len: 1370 microversion: 2.20 time: 0.116471 Aug 29 22:45:32.917722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 325/647] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:32 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:33.946230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:33.946989 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:33.953125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.953611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.954045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.954759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.955292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.955717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.969674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e HTTP/1.1 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:45:33.971366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:45:33.973099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '85dd30e7-c635-4bcd-98e3-8aa61c52d30e'} Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:33.974226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:45:33.975808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:33.977618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:33.977618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f44189e0-3b52-4124-9518-fac67d7f5b6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 404 len: 111 microversion: 2.20 time: 0.031960 Aug 29 22:45:33.977618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 323/648] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:33 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:45:33.982456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-701f0f5e-33f9-482c-97b2-0b424b2048aa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '.version_select at 0x7f5cf6c278b0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:34.003112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-701f0f5e-33f9-482c-97b2-0b424b2048aa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123635756" status: 204 len: 0 microversion: 2.20 time: 0.024630 Aug 29 22:45:34.003687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 326/649] 10.222.0.77 () {60 vars in 1259 bytes} [Mon Aug 29 22:45:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123635756 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:45:34.927009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b30b73ee-7eaf-4fc5-a1d7-c59eadb14a12 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: .version_select at 0x7f5cf6ceeca0>, body: {"keypair": {"name": "tempest-keypair-886995151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJCZNJi0sWCL8Uhz8yPmCrDIZZfuu7ShoTmg4jYd1IXQnIwpcWr/+rRcHQ5ZsX39ZnQzmdXfELPy25wLjGZsLvO43LQSL4UEoy5AbulbRBH1UMwW0/6wr+zbp8iI7/YZg=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:34.953409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-b30b73ee-7eaf-4fc5-a1d7-c59eadb14a12 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:34.960143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-b30b73ee-7eaf-4fc5-a1d7-c59eadb14a12 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for user 003dd6612cda48618966db8c0788b794 and project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:34.992002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b30b73ee-7eaf-4fc5-a1d7-c59eadb14a12 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.072126 Aug 29 22:45:34.992604 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 324/650] 10.222.0.77 () {62 vars in 1200 bytes} [Mon Aug 29 22:45:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 22:45:36.396529 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-372350137", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2d0869-f5f7-40a7-9c40-ad66d99bd892"}], "security_groups": [{"name": "tempest-securitygroup--590979474"}], "key_name": "tempest-keypair-886995151", "user_data": "}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:36.501767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] validate_networks() for [('eb2d0869-f5f7-40a7-9c40-ad66d99bd892', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:45:36.889311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:45:36.889770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:45:36.890250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:45:36.890660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:45:36.891104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:45:36.899896 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:36.900377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:36.900812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:36.901739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:36.902009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:36.902438 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:36.919782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:36.923799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Getting quotas for user 003dd6612cda48618966db8c0788b794 and project 05e6d1afb63446af887a1de133b7bf2e. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:36.935466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:45:36.937770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:45:36.989443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a72dbd93-0d6e-4ffc-bf0c-392bc2689ebd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.598410 Aug 29 22:45:36.990176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 327/651] 10.222.0.77 () {62 vars in 1188 bytes} [Mon Aug 29 22:45:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 22:45:37.004907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:37.004907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:37.074207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.082088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.083754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.085089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0ef209ce-5300-4dc9-8b70-1a96c7fdc5bd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1280 microversion: 2.20 time: 0.087724 Aug 29 22:45:37.085959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 325/652] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:36 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:37.461509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:37.464262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:37.470915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.471410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.471851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.472557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.473967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.474413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.505760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3d4a832e-07fa-453d-8f6a-f5e55f3c38f7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048796 Aug 29 22:45:37.506353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 328/653] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:45:37 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:45:37.575613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:37.576113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:37.582807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.583236 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.583778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.584520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.585071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.585547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.613182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:45:37.698950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3bb126bc-0814-4daa-a938-c75709731275 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 204 len: 0 microversion: 2.1 time: 0.126932 Aug 29 22:45:37.699791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 326/654] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:45:37 2022] DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:45:37.709850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:37.710919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:37.717227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.718035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.718850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.719617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.720078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.720621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.852526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.860423 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0dc0618b-dc53-4be8-bc75-5abf297f32ec tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1670 microversion: 2.1 time: 0.155632 Aug 29 22:45:37.861007 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 329/655] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:37 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:38.109369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:38.110235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:38.116527 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.117013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.117495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.118229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.119100 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.119256 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.194160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:38.203350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:38.204783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:38.205888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f54c57a3-1698-43ba-848a-b5a12f2b5161 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1332 microversion: 2.20 time: 0.100892 Aug 29 22:45:38.206445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 327/656] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:38 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:38.882577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:38.883283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:38.890052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.890555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.890996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.891705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.892156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.892572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.096455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.105846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-455acaad-f034-4000-a0bf-e53fb4f321a1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1670 microversion: 2.1 time: 0.227190 Aug 29 22:45:39.106470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 330/657] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:38 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:39.230468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:39.234440 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:39.249025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.249523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.249963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.250678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.251191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.251601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.329220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.337755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.339232 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.340365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1ff1b5bf-d4a0-4d09-990f-1721bb4bac2d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1332 microversion: 2.20 time: 0.114458 Aug 29 22:45:39.341098 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 328/658] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:39 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:45:40.131168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:40.131737 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:40.138925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.139418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.139848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.140558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.141002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.141420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.307722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.317150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6ae8ea3e-60b6-4b03-bf65-4b0cb7bf2ac8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1670 microversion: 2.1 time: 0.192598 Aug 29 22:45:40.317974 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 331/659] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:40 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1670 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:40.365045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:40.365676 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:40.375937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.376699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.377175 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.378298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.378560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.379088 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.453527 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.462185 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.463699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.464861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-da1b27df-e38f-4761-870e-9d864e61e770 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1338 microversion: 2.20 time: 0.104352 Aug 29 22:45:40.465428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 329/660] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:40 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:41.340465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:41.341119 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:41.348661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.349146 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.349586 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.350305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.350780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.351208 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.437062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:41.445933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a5f9019d-d5c0-4028-93db-b3a881ad68c9 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1604 microversion: 2.1 time: 0.110326 Aug 29 22:45:41.447967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 332/661] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:41 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1604 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:41.489029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:41.489957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:41.496397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.496878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.497308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.498007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.498458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.498915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.563430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c3598e5-e7bd-4b32-9ca3-1854b2a1927b"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:41.566303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:41.569261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:41.573528 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.573878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.574315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.575069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.575524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.575940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.579656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:41.581406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:41.583092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-75d0ca12-411a-4ebb-a415-7fd2790971f6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1338 microversion: 2.20 time: 0.098260 Aug 29 22:45:41.583985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 330/662] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:41 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:45:41.967826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f655b3-78d2-40f5-ac78-806952dba34b", "name": "network-vif-deleted", "tag": "62afccef-e8d2-4fce-8052-0f7da6e93ebc"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:41.984277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.986126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.986817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.991801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d91d545d-77f5-4cb0-99a9-d748cd7f4720 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431990 Aug 29 22:45:41.993830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 333/663] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:45:41 2022] POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:45:42.037115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] Creating event network-vif-deleted:62afccef-e8d2-4fce-8052-0f7da6e93ebc for instance 69f655b3-78d2-40f5-ac78-806952dba34b on hv-cinder-85427 Aug 29 22:45:42.053417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-e2e692a3-58fc-45dd-b297-4a68bbc31737 req-4fa77efd-0299-4bdb-ae39-562afb5a6b67 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089338 Aug 29 22:45:42.058350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 331/664] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:42.470847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:42.471603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:42.481116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.481636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.482431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.483247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.483990 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.484362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.520292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.521157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.522135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.523093 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 69f655b3-78d2-40f5-ac78-806952dba34b {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:42.583043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:42.590882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8d66ddb7-15bf-46a1-ab23-babaef98e39c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 200 len: 1326 microversion: 2.1 time: 0.125475 Aug 29 22:45:42.592721 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 334/665] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:42 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:42.612388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:42.613846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:42.621829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.622322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.622856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.623565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.624036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.624460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.833969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:42.844610 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:42.846707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:42.848952 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ec85cb40-93e2-460a-aa9c-1ef06f52461c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1405 microversion: 2.20 time: 0.242224 Aug 29 22:45:42.850039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 332/666] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:42 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:43.614271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:43.614918 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:43.621426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.621913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.622351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.623088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.623547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.623980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.637318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b HTTP/1.1 Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:45:43.639803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:45:43.641365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '69f655b3-78d2-40f5-ac78-806952dba34b'} Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:43.642286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:45:43.643518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:45:43.645123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:43.645123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1fd7d6fa-eef4-4f2a-bea7-d591e592e838 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 404 len: 111 microversion: 2.1 time: 0.031229 Aug 29 22:45:43.645123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 335/667] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:43 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:43.651593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4d4d86ad-563c-4b9c-a62b-35f8fe8cef2b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '.version_select at 0x7f5cf6c3caf0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:43.671817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4d4d86ad-563c-4b9c-a62b-35f8fe8cef2b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692840648" status: 202 len: 0 microversion: 2.1 time: 0.024475 Aug 29 22:45:43.672392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 333/668] 10.222.0.77 () {58 vars in 1218 bytes} [Mon Aug 29 22:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692840648 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:45:43.877089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:43.878151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:43.886155 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.886724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.887275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.888185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.888842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.889292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.043149 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:44.051978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:44.053437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:44.054552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-84c9cbe0-9777-4f78-adf9-2d96ffd7b264 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1405 microversion: 2.20 time: 0.185290 Aug 29 22:45:44.056123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 336/669] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:43 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:44.150435 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:44.162105 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.162580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.163024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.177004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] Creating event network-changed:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:45:44.183036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-3aeb24ea-c83d-4c23-b876-e162a777598d req-a5fcf5d1-99d4-42bf-ae13-631af526a466 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040475 Aug 29 22:45:44.183655 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 334/670] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:44.505645 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3fc2a559-fc49-40f8-9ef6-ab039b235ef8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: .version_select at 0x7f5cf6c27430>, body: {"keypair": {"name": "tempest-keypair-1403618343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFm1U72iHSOP2GeoVI/Ak6vHDnbHbEpCq4guuuCigzk2Rrkao0AZrSOlpu+iGxzLPvAqINPqQ3IObe7RPN3w39KvVdFLSB2vM+5r5tTqIFMRUJmLolIGqP2KjtVN1Z7Bw=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:44.526405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-3fc2a559-fc49-40f8-9ef6-ab039b235ef8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for project cf0dd257dea04aca845b17f51e1c200e. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:44.530664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-3fc2a559-fc49-40f8-9ef6-ab039b235ef8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for user 70da750fbe764462b50dc0fcef3eb0e6 and project cf0dd257dea04aca845b17f51e1c200e. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:44.558135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3fc2a559-fc49-40f8-9ef6-ab039b235ef8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056525 Aug 29 22:45:44.558763 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 337/671] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:45:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:44.965727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:44.966539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:44.975167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.975930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.976959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.978074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.978825 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.979509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:45.005882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-32d075b3-1625-4c72-b72d-e364244d6446 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.045244 Aug 29 22:45:45.007049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 335/672] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:45:44 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:45.081139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:45.082393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:45.102334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:45.104809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:45.105844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:45.107129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:45.108727 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:45.109700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:45.119408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:45.405659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:45.415976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:45.417947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:45.419231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-011da072-2f41-4a39-873c-9a6148e508c0 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1405 microversion: 2.20 time: 0.346413 Aug 29 22:45:45.421913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 338/673] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:45 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:46.231451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-253331742", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b66f117d-e67e-472b-adb6-20d24f75e534"}], "security_groups": [{"name": "tempest-securitygroup--1852079075"}], "key_name": "tempest-keypair-1403618343", "user_data": "}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:46.446071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:46.447132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:46.460539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.461333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.464895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.478949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.479760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.480474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.724936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] validate_networks() for [('b66f117d-e67e-472b-adb6-20d24f75e534', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:45:46.902015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:46.912226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:46.917675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:46.920280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:46.921876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d5b307e3-8c3c-42a2-b368-aeee04138b7a tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1405 microversion: 2.20 time: 0.482802 Aug 29 22:45:46.923135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 339/674] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:46 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:46.928160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "name": "network-vif-plugged", "status": "completed", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:46.946023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.946660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.947579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.965823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] Creating event network-vif-plugged:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:45:46.973041 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-3b403522-86bc-471f-b11b-8ac8a1b3c5ad req-cb8b68b2-542d-41d5-8369-9de4553d8c3e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048375 Aug 29 22:45:46.973674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 340/675] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:46.981127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c68d99db-6460-4792-8c12-4cc1087a23e0"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:46.983641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:46.992095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.992589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.993034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.993753 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.994399 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.995021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.079400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=6 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:47.281678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:45:47.282562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:45:47.282562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:45:47.283080 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:45:47.283412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:45:47.294959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.295826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.296626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.297961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.298451 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.299183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.319032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for project cf0dd257dea04aca845b17f51e1c200e. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:47.323105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3b94efe0-a305-47cc-8a42-89db9460b7a6 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346693 Aug 29 22:45:47.324463 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 341/676] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:45:46 2022] POST /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:47.324702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Getting quotas for user 70da750fbe764462b50dc0fcef3eb0e6 and project cf0dd257dea04aca845b17f51e1c200e. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:47.339838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:45:47.342383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:45:47.403211 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d04d2db6-78c5-430e-8b38-c773d4bc63d4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.179181 Aug 29 22:45:47.406774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 336/677] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:45:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:45:47.419953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-761572b9-4441-47db-8d97-081816a4497c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:47.421433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-761572b9-4441-47db-8d97-081816a4497c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:47.496354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-761572b9-4441-47db-8d97-081816a4497c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:47.505562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-761572b9-4441-47db-8d97-081816a4497c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1237 microversion: 2.1 time: 0.093538 Aug 29 22:45:47.506237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 342/678] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:47 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:47.949518 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:47.950131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:47.957253 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.957742 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.958184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.958929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.959392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.959849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:48.095462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.099653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:48.105257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.106788 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.107907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3e670b55-2b94-42de-a6b9-0c648c5ad1ad tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1405 microversion: 2.20 time: 0.162818 Aug 29 22:45:48.108464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 337/679] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:47 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:48.536928 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:48.538452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:48.548958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:48.549469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:48.550032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:48.551147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:48.551466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:48.552079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:48.633706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.642436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1ca4ce93-ce17-49c7-bc3c-35d6d5ebdf98 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1241 microversion: 2.1 time: 0.112059 Aug 29 22:45:48.643058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 343/680] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:48 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:49.133295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:49.133938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.142254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.142764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.143252 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.143966 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.144484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.144936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.299447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:49.311290 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:49.313442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:49.315967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c4c06733-7e3a-4f93-966e-bf8965f32670 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1597 microversion: 2.20 time: 0.187759 Aug 29 22:45:49.316761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 338/681] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:49 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1597 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:49.344140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:49.344867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.352702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.353195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.353677 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.354330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.354809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.355238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.467622 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e3650976-b435-4083-b769-14a46eda92ea tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128117 Aug 29 22:45:49.468852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 344/682] 10.222.0.77 () {60 vars in 1316 bytes} [Mon Aug 29 22:45:49 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:45:49.664196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:49.665408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.671560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.672198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.672646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.673362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.673816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.674243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.771656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:49.781602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e9460cbd-b744-4cb8-b702-b7be2c79da99 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1289 microversion: 2.1 time: 0.121377 Aug 29 22:45:49.782512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 339/683] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:49 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:49.803624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:49.807094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.814424 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.815269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.816141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.817730 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.818390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.819025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.850188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lazy-loading 'flavor' on Instance uuid 10e14e21-0dac-42c8-8199-204b86564f96 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:50.021856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-067b8093-98e5-4466-9219-650d4d32c262 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/action" status: 200 len: 32 microversion: 2.1 time: 0.224316 Aug 29 22:45:50.022778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 345/684] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:45:49 2022] POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:45:50.034430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:50.035622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:50.042558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.043078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.043509 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.044205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.044826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.045998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.227569 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:50.237419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b49cd8a5-25c0-4339-9e1c-651d6823db75 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.207126 Aug 29 22:45:50.238058 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 340/685] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:50 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:50.812545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:50.813459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:50.825625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.826126 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.826569 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.827362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.827827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.828258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.900218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:50.909676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5aed5075-eb1e-40ac-aa56-1c7f88065fde tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1295 microversion: 2.1 time: 0.101476 Aug 29 22:45:50.910270 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 346/686] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:50 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:51.261002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:51.261974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.270506 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.271074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.271670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.272473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.272934 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.273359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.423897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:51.433754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-524740d4-5d47-456f-bda0-e01bddc906a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.177472 Aug 29 22:45:51.434365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 341/687] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:51 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:51.631212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:51.643601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.645014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.645746 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.659413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] Creating event network-changed:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:45:51.664857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-2447a8d1-b912-4de4-ba4d-23f7e7a2c88b req-1e6dc161-1639-466e-8e3b-39a015585adb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039024 Aug 29 22:45:51.666590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 347/688] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:51.934414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:51.935134 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.944243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.945360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.946057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.947094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.947850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.948659 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:52.164323 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:52.173679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-acbb3180-3fb8-42f0-96c4-8fc8e03c1b62 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.244395 Aug 29 22:45:52.174665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 342/689] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:51 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:52.459842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:52.460693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:52.471233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:52.473904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:52.475641 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:52.477277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:52.478108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:52.478900 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:52.672952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:52.685651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ba1c19d3-c37e-4e27-aaab-de3acfc45033 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.232822 Aug 29 22:45:52.686293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 348/690] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:52 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:53.203104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:53.204167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:53.213364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.214192 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.214969 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.216167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.217010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.217861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.358467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:53.367156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-98b9a113-52b2-4627-806d-a51b3e46cc30 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.171342 Aug 29 22:45:53.367737 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 343/691] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:53 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:53.683716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f91121-8c3c-48c9-ac28-a04ee9f1884d", "tag": "20742b6f-8340-4fe9-a393-9ada56f123b0"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:53.694637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.695171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.695702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.708973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] Creating event network-changed:20742b6f-8340-4fe9-a393-9ada56f123b0 for instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d on hv-cinder-85427 Aug 29 22:45:53.709998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:53.710613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:53.714318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-d043ed03-adf0-427c-a5d3-692a5992a76c req-8fef1b11-a884-462b-8c23-88c9a248ee77 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Aug 29 22:45:53.714955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 349/692] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:53.718892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.719388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.719821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.720537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.720986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.721410 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.868305 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:53.880139 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3a14a5e7-7b70-4f8e-9ff7-c1f4c19686ab tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.174444 Aug 29 22:45:53.880900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 344/693] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:53 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:54.390404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:54.391226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:54.398158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.398644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.399196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.400176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.400724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.401161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.554443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:54.563938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-42691275-9c91-4782-a18b-e02358d6f0c8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.177782 Aug 29 22:45:54.564938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 350/694] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:54 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:54.902840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:54.903477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:54.909807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.910308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.910777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.911499 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.911967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.912391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.089296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:55.105187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5d83edc8-3e17-47c5-80d0-c42f53e20eb0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.206249 Aug 29 22:45:55.106204 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 345/695] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:54 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:55.587806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:55.588652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:55.597002 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.598291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.598890 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.599650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.600282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.600820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.777352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:55.788927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2dec21d4-aed2-4fc5-a4d1-095870973238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.205583 Aug 29 22:45:55.790066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 351/696] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:55 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:56.135404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c68d99db-6460-4792-8c12-4cc1087a23e0"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:56.138238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:56.140571 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:56.141196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:56.141471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:56.146596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.147119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.147563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.148290 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.148731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.149156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.149543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.150196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.150656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.151931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.152533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.152812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.243579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: POST /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments HTTP/1.1 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 74 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:45:56.246085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {"volumeAttachment": {"volumeId": "c68d99db-6460-4792-8c12-4cc1087a23e0"}} Aug 29 22:45:56.252459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'server_id': 'c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6', 'body': {'volumeAttachment': {'volumeId': 'c68d99db-6460-4792-8c12-4cc1087a23e0'}}} Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:56.255235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:56.257905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 400 to user: Invalid volume: volume c68d99db-6460-4792-8c12-4cc1087a23e0 is already attached to instances: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-61ca692b-9a57-489c-86a4-abf2f47901ab tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117086 Aug 29 22:45:56.260684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 346/697] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:45:56 2022] POST /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:45:56.331356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:56.332428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:56.332944 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:56.340187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.341062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.341576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-bb580663-6768-44db-b884-ee1f51d119a3 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.205015 Aug 29 22:45:56.341723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.342431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.342556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 352/698] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:56 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:56.343648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.344261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.449536 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'services' on Instance uuid c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:56.549392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-806eb1e3-e5a1-4913-95ba-908acf1a0127 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments/c68d99db-6460-4792-8c12-4cc1087a23e0" status: 202 len: 0 microversion: 2.1 time: 0.220157 Aug 29 22:45:56.550893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 347/699] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:45:56 2022] DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments/c68d99db-6460-4792-8c12-4cc1087a23e0 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:45:56.561557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:56.564841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:56.569635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:56.577629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.578769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.579613 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.581066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.582530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.583295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.635476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cddea61b-18fb-4acd-833a-9ed9fec1356d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079137 Aug 29 22:45:56.637305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 353/700] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:45:56 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:56.814291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:56.815085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:56.823391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.823892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.824327 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.825043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:56.825500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:56.825923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:56.989532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.005042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f5e990b2-6e86-4140-b0f7-fc3365084e1c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.194842 Aug 29 22:45:57.006109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 348/701] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:56 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:57.365361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.366012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.375358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.376153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.376685 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.377887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.379048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.379495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.504978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=12 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.565107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.569772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.577004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a6d94a61-019e-4324-9028-87e010ab50a6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.216514 Aug 29 22:45:57.583114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 354/702] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:57 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:57.650921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.653303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.656055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.657415 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=6 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.664931 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.665468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.665923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.666679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.667223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.667748 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.703018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-77a90e92-0e51-48a5-a028-3a2b764f8fa9 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056901 Aug 29 22:45:57.703623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 349/703] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:45:57 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:45:57.778101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.778825 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.788911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.789883 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.791020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.792570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.792788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.793362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.825143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:45:57.926614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f8adbfd9-572b-420e-93c4-10598a9150fc tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 204 len: 0 microversion: 2.1 time: 0.153295 Aug 29 22:45:57.927516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 355/704] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:45:57 2022] DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:45:57.941458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.943347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.951478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.952166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.952710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.953535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.954085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.954615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.049067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:58.050973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:58.063120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.064043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.064859 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.066788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.067986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.068806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.115362 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.124376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4cc69ba4-f7e6-42f2-943b-f2153c501b8e tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1681 microversion: 2.1 time: 0.190567 Aug 29 22:45:58.124961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 350/705] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:57 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:58.239902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.248317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2bb97ba0-70b6-423b-b718-aeee1542ff63 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.207960 Aug 29 22:45:58.248898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 356/706] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:58 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:58.507201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f91121-8c3c-48c9-ac28-a04ee9f1884d", "name": "network-vif-plugged", "status": "completed", "tag": "20742b6f-8340-4fe9-a393-9ada56f123b0"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:58.520672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.521302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.521945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.536904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] Creating event network-vif-plugged:20742b6f-8340-4fe9-a393-9ada56f123b0 for instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d on hv-cinder-85427 Aug 29 22:45:58.542558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-025e2f81-b9f9-470f-b875-a2aed43b411c req-de436ff4-3164-45f5-8ebd-79b947dc659d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040082 Aug 29 22:45:58.543830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 351/707] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:45:58.599412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:58.600741 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:58.606972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.607461 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.607900 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.608618 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.609077 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.609505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.771768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.780737 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e21a23ef-0860-4a30-aef5-ad0f21b49293 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.185539 Aug 29 22:45:58.781471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 357/708] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:58 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:59.160016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:59.160826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:59.168072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.168564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.169005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.170018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.170541 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.171057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.271180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:59.272077 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:59.280524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.281228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.281675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.282375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.283093 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.283717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.341084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:59.350459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d3e6f1fc-48ca-4505-811e-7ae2fecc3b9b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1681 microversion: 2.1 time: 0.197871 Aug 29 22:45:59.351098 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 352/709] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:59 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:59.449169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:59.458209 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6ef90ff3-acd2-469b-88ce-129dbf98c05c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.192515 Aug 29 22:45:59.458818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 358/710] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:59 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:59.808666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:59.809524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:59.816975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.817594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.818029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.818756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.819395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.820100 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.998496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.009752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ceb91ba0-eeee-4dd1-8efc-2d765e0301ba tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.205269 Aug 29 22:46:00.010836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 353/711] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:59 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:00.379475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:00.381685 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:00.390587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.391259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.391836 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.392600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.393064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.393524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.483683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:00.485120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:00.496379 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.497316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.498140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.499445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.500311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.501140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.530522 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:00.574864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.608243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8a35fd34-bfcc-4d9b-8e4a-ca373f1e4b7a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1681 microversion: 2.1 time: 0.235365 Aug 29 22:46:00.610495 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 359/712] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:00 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:00.689042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.701396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4132b553-cfd5-4e59-9948-9921b852e238 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1363 microversion: 2.1 time: 0.224751 Aug 29 22:46:00.702224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 354/713] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:00 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:00.894400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6", "name": "network-vif-deleted", "tag": "5cad65a1-8559-48f6-bc5a-957d654be244"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:00.907339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.907904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.908774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.921958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] Creating event network-vif-deleted:5cad65a1-8559-48f6-bc5a-957d654be244 for instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 on hv-cinder-85427 Aug 29 22:46:00.930117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-c0aa057d-a1ed-4a4c-ba05-906f59d0e2db req-14231d22-d264-4c77-a6a3-3990c7931ed3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041826 Aug 29 22:46:00.931368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 360/714] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:01.046517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:01.048419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:01.059200 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.060361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.061353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.062897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.063597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.064176 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.243597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:01.254765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-edfd9354-e947-4824-908b-9fc731ceff2c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.215936 Aug 29 22:46:01.255591 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 355/715] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:01 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:01.635326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:01.635911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:01.642566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.643088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.643530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.647098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.647628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.648080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.691634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.692575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.693230 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.693857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'fault' on Instance uuid c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:46:01.724128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:01.725469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:01.732904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.733686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.734231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.735254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.735831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.736368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.761778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:01.775715 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e7300054-b161-45d5-83e9-91c043fc5c74 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 200 len: 1330 microversion: 2.1 time: 0.145432 Aug 29 22:46:01.777115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 361/716] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:01 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 1330 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:01.921463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:01.930635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-07967f20-1f9b-49c7-9c97-40a37401a563 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1549 microversion: 2.1 time: 0.211462 Aug 29 22:46:01.931348 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 356/717] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:01 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:01.967691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:01.968929 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:01.980392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.981190 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.981853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.982719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.983502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.984126 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.081749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-87dc8a50-2f93-48a2-9421-9fd229dbe962 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121413 Aug 29 22:46:02.082636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 362/718] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:46:01 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:02.277260 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:02.277923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:02.286675 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.287427 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.287870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.288642 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.289276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.289720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.492853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:02.502897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-67363807-26b1-4512-ae92-4f22d078d9b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.229346 Aug 29 22:46:02.504052 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 357/719] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:02 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:02.808831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:02.809577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:02.819286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.819902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.820594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.821302 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.821947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.822365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.840339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 HTTP/1.1 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:46:02.842666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:46:02.844426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6'} Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:46:02.845284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:46:02.846686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:46:02.848473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:46:02.848473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-575b1508-02e6-46bb-8dc4-d4fdd26bd42d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 404 len: 111 microversion: 2.1 time: 0.041529 Aug 29 22:46:02.851524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 363/720] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:02 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:46:02.857261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5c6739da-bc5f-44b6-95ba-b2f1af07c2aa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '.version_select at 0x7f5cf6dfdaf0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:02.881816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5c6739da-bc5f-44b6-95ba-b2f1af07c2aa tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52665640" status: 202 len: 0 microversion: 2.1 time: 0.028686 Aug 29 22:46:02.882530 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 358/721] 10.222.0.77 () {58 vars in 1215 bytes} [Mon Aug 29 22:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52665640 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:46:03.231743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f91121-8c3c-48c9-ac28-a04ee9f1884d", "tag": "20742b6f-8340-4fe9-a393-9ada56f123b0"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:03.254686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.255876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.256789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.287482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] Creating event network-changed:20742b6f-8340-4fe9-a393-9ada56f123b0 for instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d on hv-cinder-85427 Aug 29 22:46:03.296811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-4b776ca8-0ae2-4c47-9a47-de57ab647c94 req-e370a5ad-1f8a-48d4-be68-c6d3320bb4b9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072319 Aug 29 22:46:03.298793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 364/722] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:03.529157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:03.529810 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:03.535804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.536535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.536967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.537662 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.538268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.539259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.965416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5a298f15-974b-475b-ba26-7b9385fb1d28 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: .version_select at 0x7f5cf6e2e670>, body: {"keypair": {"name": "tempest-keypair-626488824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRKF++hPLfGiX72yvsZ3NIKy7UvukW1yFaIXr5VjKsHaajoNJPgPLiljoST/gqnWaeI5UsS/Fx4kLKQGokmW22wPC3JHg0ltEY4B4qLVZvOG63mR6jbRjuMJAI4gWdWhQ=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:03.988436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-5a298f15-974b-475b-ba26-7b9385fb1d28 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:03.993943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-5a298f15-974b-475b-ba26-7b9385fb1d28 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:04.014062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:04.027617 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4c62f325-617d-4ca3-ab2f-940cd9d0b326 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.502565 Aug 29 22:46:04.028668 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 359/723] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:03 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:04.031407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5a298f15-974b-475b-ba26-7b9385fb1d28 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071151 Aug 29 22:46:04.032019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 365/724] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:46:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:05.054094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:05.054795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:05.061270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.061752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.062208 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.062926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.063375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.063792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.289777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.298307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8cd56ab9-4f8e-413b-8b7e-dd5b14864801 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.248610 Aug 29 22:46:05.298910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 360/725] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:05 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:05.523334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1525807416", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4fab7c6-be28-40e9-82ea-67b0ac291d9e"}], "security_groups": [{"name": "tempest-securitygroup--1593294635"}], "key_name": "tempest-keypair-626488824", "user_data": "}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:05.632179 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] validate_networks() for [('c4fab7c6-be28-40e9-82ea-67b0ac291d9e', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:46:06.071200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:46:06.071629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:46:06.072104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:46:06.072522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:46:06.072934 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:46:06.083282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.083771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.084206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.084953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.085413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.085841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.105466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:06.110455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Getting quotas for user cc7aa14777ab43a083b3a120c4349d67 and project 1fcb391184b94306898e43379094e5f6. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:06.128954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:46:06.133315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:46:06.196031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ef05b788-6800-4a31-b3fe-1b514e0ae571 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734718 Aug 29 22:46:06.196651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 366/726] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:46:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:46:06.214086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f57ee7cf-90e6-46ee-8c14-23fcafc82a5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:06.215159 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f57ee7cf-90e6-46ee-8c14-23fcafc82a5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:06.284512 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f57ee7cf-90e6-46ee-8c14-23fcafc82a5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:06.294371 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f57ee7cf-90e6-46ee-8c14-23fcafc82a5c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1241 microversion: 2.1 time: 0.086110 Aug 29 22:46:06.294989 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 361/727] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:06 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:06.324636 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:06.325838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:06.337389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.338394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.339322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.340616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.341456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.342245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.513665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:06.528554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3dc0330f-b941-44ba-bbb3-49fef77ad5fa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.212161 Aug 29 22:46:06.529413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 367/728] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:06 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:07.326531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:07.327433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:07.336617 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.337249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.337976 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.338862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.339327 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.339753 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.425845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.438348 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-16ffa2ae-c4b2-4e2d-8ab1-0e1fbab075f5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1293 microversion: 2.1 time: 0.115889 Aug 29 22:46:07.439274 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 362/729] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:07 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:07.553816 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:07.554652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:07.562692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.563217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.563642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.564351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.564800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.565222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.728530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.737560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c94c30c8-7d77-4b53-aee5-b2b32fb73258 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.189192 Aug 29 22:46:07.738619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 368/730] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:07 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:08.467463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:08.468484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:08.477016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.477621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.478365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.479401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.479868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.480298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.559286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.567817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5de725be-263c-4ec9-b902-eacdad3d3557 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1299 microversion: 2.1 time: 0.104195 Aug 29 22:46:08.568657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 363/731] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:08 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:08.761774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:08.762935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:08.771077 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.771826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.772614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.773536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.774674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.775354 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.966706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-174ab21f-6333-4b1e-9483-76e8ae8bccd6 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.218548 Aug 29 22:46:08.977986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 369/732] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:08 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:09.547576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9ef285-a525-42c1-a3b3-eb2383a04797", "tag": "fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:09.564471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.566154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.567178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.597104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:09.598182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:09.600995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] Creating event network-changed:fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559 for instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 on hv-cinder-85427 Aug 29 22:46:09.609553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-e721dff0-fd71-4577-8786-af07fcd25613 req-1b6387d5-1727-4c9a-a91c-2e7b0c48e301 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067439 Aug 29 22:46:09.610940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 364/733] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:09.612459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.613344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.614105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.615436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.616226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.617455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.812756 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.826802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4484fe9e-dbd4-44fa-ba6c-d9cb7f73d6c2 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.236263 Aug 29 22:46:09.827992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 370/734] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:09 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:10.016850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:10.017916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:10.027867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.028361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.028903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.029805 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.030384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.031170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.238897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.252041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e77e666a-8ad0-4658-bcf3-07975bdc8e20 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.241235 Aug 29 22:46:10.253000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 365/735] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:10 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:10.865212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:10.866349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:10.874635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.875152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.875595 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.876325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.876788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.877219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.093713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.103219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-06893833-fe90-4c17-9b81-1cd1d5a38b21 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.244632 Aug 29 22:46:11.104013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 371/736] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:10 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:11.288721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:11.289598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:11.298587 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.299376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.300470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.301407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.302146 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.302702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.495333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.505667 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-691cd922-adaf-413c-aa59-bd1a6db54330 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.221786 Aug 29 22:46:11.506516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 366/737] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:11 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:12.130326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.131340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:12.142577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.144007 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.144778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.146016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.146857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.147606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.349925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:12.358807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7786e705-cfc7-41d8-a717-b19fba77a9ce tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.235575 Aug 29 22:46:12.359590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 372/738] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:12.545051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.546243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:12.557453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.558337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.558986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.560005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.560621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.561328 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.802184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:12.813586 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-001f65ed-7111-4722-b400-a7c2cf50afaa tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.276747 Aug 29 22:46:12.814215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 367/739] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:13.393110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.394280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:13.405935 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.406814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.407384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.408639 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.409872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.410309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.435797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:13.583584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.592478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d3cd88ce-68e8-4c98-b4df-080285d6f4d8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.206738 Aug 29 22:46:13.593322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 373/740] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:13.839078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.839720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:13.846769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.847272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.847713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.848431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.848887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.849315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.996016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.005538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6885b639-b252-4d1e-bdf8-cd7b974d9721 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.172538 Aug 29 22:46:14.006125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 368/741] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:14.634486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9ef285-a525-42c1-a3b3-eb2383a04797", "name": "network-vif-plugged", "status": "completed", "tag": "fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:14.635292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:14.636414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:14.649136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.650120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.651221 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.652521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.653374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.654159 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.654684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.655341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.671175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.686039 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] Creating event network-vif-plugged:fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559 for instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 on hv-cinder-85427 Aug 29 22:46:14.693582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-3745f8a3-1b96-4846-8c00-304a502cab9d req-04f30452-14a4-4cc8-b251-68dbe87bd779 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066565 Aug 29 22:46:14.694489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 374/742] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:14.839163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.848921 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-540f2972-cdf8-4435-b5e6-b9bf06febf50 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.222044 Aug 29 22:46:14.849648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 369/743] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:14 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:15.035579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.037174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.048649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.050489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.051431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.052743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.054364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.055389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.272724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.287192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c501e500-bc8f-419c-9cc5-7e62976af22a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1736 microversion: 2.1 time: 0.260422 Aug 29 22:46:15.288195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 375/744] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:15.873119 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.874219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.886657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.887519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.888281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.889492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.890291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.891068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.084372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.098752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2a4be8d2-5bd2-4978-931b-afb23a227387 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1367 microversion: 2.1 time: 0.230567 Aug 29 22:46:16.099408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 370/745] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:16.325388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:16.326425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.330355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.331784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=10 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.341590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.342408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.343418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.344210 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.344894 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.345619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.540474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.556165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a0bf103a-e2f8-463a-aa92-64ca10bba6cd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1716 microversion: 2.1 time: 0.237464 Aug 29 22:46:16.557169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 376/746] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:16 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1716 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:16.729377 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:16.729861 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.731807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.738653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.739159 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.739630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.740393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.740966 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.741480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.847268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] HTTP exception thrown: Cannot 'detach_volume' instance 10e14e21-0dac-42c8-8199-204b86564f96 while it is in vm_state rescued Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Request method failure captured: Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments/2c3598e5-e7bd-4b32-9ca3-1854b2a1927b HTTP/1.1 Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUDPMUFH2PrfWVx5qSdxVYWft2KxPLMI2cOV9TV7arGTPNVZ3nWwucj-36kRePsg1Fef1-K2zRx6d9OPNV8AChtC5q5Wmn2xPqUU24fb00xGE_V2vrZAw9jPIXaPBuUl9-Bw6lP25Gx513vnRr-G1PUTGZV5BHG2QrHmAm5z3WJVxRg Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:46:16.850403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_8ad722485ac34d1796f03003fbcde07a", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}] Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 8b46b3fa1df24c80ab7315c4ff44c064 Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:46:16.853258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Cannot 'detach_volume' instance 10e14e21-0dac-42c8-8199-204b86564f96 while it is in vm_state rescued Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'server_id': '10e14e21-0dac-42c8-8199-204b86564f96', 'id': '2c3598e5-e7bd-4b32-9ca3-1854b2a1927b'} Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10e14e21-0dac-42c8-8199-204b86564f96 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:46:16.854690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 10e14e21-0dac-42c8-8199-204b86564f96 while it is in vm_state rescued Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 10e14e21-0dac-42c8-8199-204b86564f96 while it is in vm_state rescued Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:46:16.857521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Returning 409 to user: Cannot 'detach_volume' instance 10e14e21-0dac-42c8-8199-204b86564f96 while it is in vm_state rescued {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:46:16.859420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8ee4a62c-8204-4eab-b253-eb86b5758158 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments/2c3598e5-e7bd-4b32-9ca3-1854b2a1927b" status: 409 len: 152 microversion: 2.1 time: 0.127314 Aug 29 22:46:16.859420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 371/747] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:46:16 2022] DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments/2c3598e5-e7bd-4b32-9ca3-1854b2a1927b => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 22:46:16.864166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:16.864775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.873102 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.873586 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.874098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.875325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.875958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.876563 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.995930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e8b49705-2378-4fd4-a0b0-051d9c42f9a1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/action" status: 202 len: 0 microversion: 2.1 time: 0.136565 Aug 29 22:46:16.998055 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 377/748] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:46:16 2022] POST /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:46:17.010703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.011726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.026343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.027173 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.028262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.029501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.030563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.031354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.136370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.138164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.149791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.151245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.151376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.152473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.153216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.153912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.309374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:17.325476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5bccc3a5-a0d0-478b-a8ed-254af58815b8 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1724 microversion: 2.1 time: 0.321158 Aug 29 22:46:17.327038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 372/749] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:17.422899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:17.432937 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-446244a7-4216-4bc8-94ed-f0e06cb5af7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1557 microversion: 2.1 time: 0.306838 Aug 29 22:46:17.433997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 378/750] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1557 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:17.477997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.478940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.489897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.490783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.491545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.492822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.493565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.494183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.620949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6ab125f7-50e6-405a-9186-e8dae4325e17 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154221 Aug 29 22:46:17.621906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 373/751] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:18.372729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:18.373422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:18.385301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.386139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.386915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.388709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.389547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.390308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.686022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.698783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-84fc96ea-3a0e-463d-ba9c-86ef3c0d12ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1724 microversion: 2.1 time: 0.332551 Aug 29 22:46:18.699839 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 379/752] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:18 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:19.261026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9ef285-a525-42c1-a3b3-eb2383a04797", "tag": "fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:19.279864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.280587 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.281184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.287744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:19.303481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] Creating event network-changed:fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559 for instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 on hv-cinder-85427 Aug 29 22:46:19.312925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-0e51762e-179f-467f-b417-7e8916785abf req-d48a4199-936f-4c3b-9ed6-e0c299ce1065 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170911 Aug 29 22:46:19.314128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 374/753] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:19.732129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:19.733382 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:19.746316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.747586 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.748757 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.750536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.751505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.752351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.012597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.028614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3b3307e6-6175-41bd-8290-2a8058b90cce tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1724 microversion: 2.1 time: 0.305612 Aug 29 22:46:20.029703 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 380/754] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:19 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:21.071476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:21.072634 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:21.083430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.084206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.084916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.086044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.086864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.087521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.655780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:21.668013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4297ba31-1f73-458d-940b-3c4c6f9969b0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1730 microversion: 2.1 time: 0.605205 Aug 29 22:46:21.668789 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 375/755] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:21 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1730 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:21.703927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:21.704811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:21.717556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.718659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.719469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.721782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.722787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.723558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.857054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4f39ea20-7bd1-4686-995f-05640595fc34 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160455 Aug 29 22:46:21.858029 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 381/756] 10.222.0.77 () {58 vars in 1275 bytes} [Mon Aug 29 22:46:21 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:23.409639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:23.425705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.426458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.427162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.444510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] Creating event network-changed:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:46:23.458693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-fbc2930d-da74-40c1-bf4a-e4eb79f65160 req-a9e42c54-53d4-41f3-ad62-2d2c1b65a921 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055347 Aug 29 22:46:23.459615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 376/757] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:25.477090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:25.490227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.491055 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.491752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.509516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] Creating event network-changed:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:46:25.518869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-65d493f0-57a6-4a81-940c-475e8a51d833 req-468f9fa7-c65d-44ea-98f0-e543138da0cc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Aug 29 22:46:25.519670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 382/758] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:28.342208 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:28.343487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:28.346980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:28.355741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.356457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.356998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.357797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.358349 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.358917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.396638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cacd9c57-76a9-43f6-8fcf-170aaf18942c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/ips" status: 200 len: 151 microversion: 2.20 time: 0.220687 Aug 29 22:46:28.397470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 377/759] 10.222.0.77 () {60 vars in 1289 bytes} [Mon Aug 29 22:46:28 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/ips => generated 151 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:46:30.761943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:30.763617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:30.766815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:30.778284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.779150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.779891 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.781125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.781907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.782412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.833068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'flavor' on Instance uuid 73099323-acd0-470f-a0e8-5fe1c43ffa61 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:46:31.116716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3932859a-d911-4f6e-bae9-6db349e0a452 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/action" status: 202 len: 0 microversion: 2.20 time: 0.362940 Aug 29 22:46:31.117542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 383/760] 10.222.0.77 () {62 vars in 1319 bytes} [Mon Aug 29 22:46:30 2022] POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:46:31.128336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:31.129704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:31.140113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.140616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.141067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.141883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.142357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.142922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.330467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.344641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.346864 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.348168 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cbae58fc-9506-47ef-9655-1d446c3672bc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.225192 Aug 29 22:46:31.348838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 378/761] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:31 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:32.378103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:32.379491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:32.390572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.391278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.391774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.393267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.394090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.394649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.593351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.607542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.609096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.610864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2ea7989e-1cba-463a-827f-38cf82a90a58 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.241145 Aug 29 22:46:32.612388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 384/762] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:32 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:33.651930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:33.652597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:33.662083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.663002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.663772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.665069 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.665848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.666507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.886580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.902461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.905428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.907812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d23cbcc8-dff8-4260-bb82-d14e421238c4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.260175 Aug 29 22:46:33.908869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 379/763] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:33 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:34.953654 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:34.954630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:34.966222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.967175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.967949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:34.969422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.970271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.971557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.167099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.183055 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.186017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.188224 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-eff29ea7-2a7c-4a95-8119-784b2a6b6ce1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.241417 Aug 29 22:46:35.189235 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 385/764] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:34 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:36.216033 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:36.216933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:36.224643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.225173 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.225702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.226641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.227074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.227919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.385338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.397585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.399752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.401560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6ded324e-1dfd-439e-aab9-c11a1afeeeca tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.189669 Aug 29 22:46:36.402376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 380/765] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:36 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:37.430509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:37.431330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:37.437953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.438433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.438910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.440175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.440632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.441058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.608028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.617781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.619252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.620502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fe2b74d6-f387-4aef-9bda-02419ff7c2cc tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.194484 Aug 29 22:46:37.621135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 386/766] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:37 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:38.648956 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:38.650372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:38.661274 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.661881 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.662570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.663466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.664002 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.664507 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.868106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.878015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.879663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.881057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0dc67338-77b4-4eb2-b8ae-f7d0bf681bd5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.240161 Aug 29 22:46:38.881728 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 381/767] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:38 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:39.907532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:39.909140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:39.916663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:39.917209 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:39.917686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:39.918396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:39.918895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:39.919483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.129733 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:40.144755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:40.147608 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:40.149849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ac640974-a01a-4e4e-8574-02940a71efd2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.246059 Aug 29 22:46:40.150868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 387/768] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:39 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:41.191866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:41.192991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:41.202925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:41.203420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:41.203924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:41.204684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:41.205692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:41.206118 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:41.374854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.385042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.387880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.389821 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b28090ca-2498-42e3-808e-ed585a07cb9f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.204889 Aug 29 22:46:41.390808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 382/769] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:41 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:42.424957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:42.425759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:42.433464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:42.434008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:42.434502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.435362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:42.435836 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:42.436267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.623558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.630101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:42.639686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.642075 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.644803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2fb6904e-0190-44b9-a275-7bd8887b3f94 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.225046 Aug 29 22:46:42.645775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 388/770] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:42 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:43.672828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:43.674254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:43.683736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.684230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.684671 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.685374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.685827 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.686251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.851917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.860761 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.862901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.864084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4706c56a-acf0-481a-8c4c-5aaf8500108d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.195342 Aug 29 22:46:43.864647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 383/771] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:43 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:44.903803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:44.904843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:44.914648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.915547 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.916395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:44.917671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.918315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.919079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:45.119788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.128995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.130670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.132036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9c5ff06b-6483-433d-9955-e0144a2673e1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.236476 Aug 29 22:46:45.132661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 389/772] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:44 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:46.160149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:46.161012 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:46.170769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.171668 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.172195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.173265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.174528 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.175271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.345047 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.355957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.357431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.358595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d7b033dc-2ee2-4ef7-be80-bf22efd80ca9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.205290 Aug 29 22:46:46.359189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 384/773] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:46 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:47.246954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:47.247799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:47.255251 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:47.255881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:47.256428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:47.257235 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:47.257793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:47.258538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:47.286327 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a60c255e-5dcc-4821-9c41-a6e208a3acb1 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/ips" status: 200 len: 145 microversion: 2.1 time: 0.104565 Aug 29 22:46:47.287044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 390/774] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:46:47 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/ips => generated 145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:47.398756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:47.399903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:47.408799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:47.409731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:47.410310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:47.411188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:47.411867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:47.412468 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:47.602094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:47.617547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:47.620317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:47.622382 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-08cbc342-46d1-4296-8b42-c6d19106b107 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.228274 Aug 29 22:46:47.635310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 385/775] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:47 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:48.663485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:48.664604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:48.671705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.672188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.672627 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.673329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.673799 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.674222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.862122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.863359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7cb2dd4-86b6-44ac-a333-477cbee03991"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:48.867538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:48.879414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.880256 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.880938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.881127 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.882409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.883237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.884078 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.884310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.886295 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-60a659d0-57b9-4622-9b6d-35c7794dbfb4 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.228840 Aug 29 22:46:48.887368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 391/776] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:48 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:49.263994 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-18389846-f994-42e2-8f3a-96d9b8bc5453 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406911 Aug 29 22:46:49.264685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 386/777] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:46:48 2022] POST /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:49.928260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:49.929221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:49.939738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.940602 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.941377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.942634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.943496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.944258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:50.174112 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.187107 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.190603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.192865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-542d3c9e-e5d4-4d73-892a-993be7bad7a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.271038 Aug 29 22:46:50.193893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 392/778] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:49 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:51.223576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:51.224764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:51.235658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:51.237049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:51.237807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:51.239133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:51.239929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:51.240694 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:51.248202 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:51.417039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.426845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.428301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.429467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9b3278b0-e6b0-49c4-9b7f-363b6282ac51 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.215178 Aug 29 22:46:51.430022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 387/779] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:51 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:52.458912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:52.459992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:52.471153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:52.472017 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:52.472761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:52.473995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:52.474864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:52.476647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:52.670850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:52.682937 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:52.685203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:52.687012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c1f39508-78c3-49bb-aa26-f57983309ee3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1742 microversion: 2.20 time: 0.236268 Aug 29 22:46:52.687745 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 393/780] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:52 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1742 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:53.713558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:53.714422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:53.724961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:53.725484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:53.725929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:53.726873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:53.727265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:53.727708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:53.914282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.928773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.931814 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.933976 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-267ce546-3e6c-42a7-8e49-3d27a693b6b7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1742 microversion: 2.20 time: 0.224791 Aug 29 22:46:53.935113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 388/781] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:53 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:54.976403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:54.977572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "name": "network-vif-plugged", "status": "completed", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:54.978182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:54.990083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:54.990992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:54.991784 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:54.993072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:54.993910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:54.994658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:55.013373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:55.014211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:55.015004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:55.036519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] Creating event network-vif-plugged:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:46:55.044996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-45ea12d4-9ea2-44ba-b3ff-f2ee2b708361 req-1971be44-b27f-4eb4-9312-59ca8e168e42 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157290 Aug 29 22:46:55.050696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 394/782] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:55.183460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.198334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.201140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.203292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7b1dc2b8-cc45-42aa-8282-8ed8e70b45f5 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.239626 Aug 29 22:46:55.204301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 389/783] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:54 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:56.234656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:56.235844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:56.242583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:56.243189 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:56.243833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:56.244709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:56.245486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:56.246186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:56.490681 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.499987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.502253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.503631 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b74391d5-731d-4e05-adb3-29af7299ccaa tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.275229 Aug 29 22:46:56.518769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 395/784] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:56 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:57.139124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:57.143077 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:57.152832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.153331 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.153987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.155106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.155572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.156184 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.203873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7d53b975-bd6d-45fd-86e5-555067798ef5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072378 Aug 29 22:46:57.204438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 390/785] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:46:57 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:57.218863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:57.219493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:57.228989 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.229976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.230673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.231551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.232096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.232546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.276981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-05f9d5a3-aee6-4bb2-940b-46305228c6b2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991" status: 200 len: 194 microversion: 2.1 time: 0.062405 Aug 29 22:46:57.283570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 396/786] 10.222.0.77 () {58 vars in 1413 bytes} [Mon Aug 29 22:46:57 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:57.541760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:57.542673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:57.554796 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.559959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.561163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.562213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.563282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.564477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.958981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:57.973957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:57.975561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:57.976809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0e5a2f4d-dbe1-474e-824c-8e2d58984fa6 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.442598 Aug 29 22:46:57.977385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 391/787] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:57 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:58.949385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bca4c55-d3b9-44dc-b893-02ac4b665ea0"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:58.952953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:58.962874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:58.963551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:58.964223 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:58.965423 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:58.965968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:58.966409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:59.016484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:59.017905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:59.039236 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=30 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:59.042443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:59.043901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:59.044741 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:59.045833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:59.046552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:59.047182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:59.295751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.322780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.326114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.328535 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f54decc1-d76a-4c9b-8985-7a9bc110bb07 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.317540 Aug 29 22:46:59.330458 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 392/788] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:59 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:59.438604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6dd4df87-5613-43fc-95b0-b0317ab3fa93 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "POST /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494358 Aug 29 22:46:59.439729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 397/789] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:46:58 2022] POST /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:00.376221 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:00.377773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:00.388557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:00.389395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:00.389837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:00.390545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:00.391016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:00.391632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:00.614653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.630069 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.635940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.638062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d63170ef-3ca3-48f6-856c-771f5a745412 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.267385 Aug 29 22:47:00.639492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 393/790] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:00 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:01.356124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:01.356966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:01.359362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=30 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:01.368670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.369466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.370169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.371128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.371838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.372441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.512865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lazy-loading 'services' on Instance uuid 10e14e21-0dac-42c8-8199-204b86564f96 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:01.641734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8a95f790-c2b6-4464-9c63-6c0ef33a19d9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments/2c3598e5-e7bd-4b32-9ca3-1854b2a1927b" status: 202 len: 0 microversion: 2.1 time: 0.290421 Aug 29 22:47:01.642898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 398/791] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:01 2022] DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments/2c3598e5-e7bd-4b32-9ca3-1854b2a1927b => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:47:01.654590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:01.656916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:01.665771 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.666510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.667239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.668120 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.669106 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.669699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.679106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:01.680084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:01.689659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.690304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.691244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.692334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.694263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.695603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.736700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7c946666-d995-47f0-acea-09fcd0be0e8e tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086704 Aug 29 22:47:01.745064 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 394/792] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:01 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:01.946398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.957105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.958966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.960827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dee417bb-4e07-4fe6-b81e-8afd2ed82ebb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.294147 Aug 29 22:47:01.976945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 399/793] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:01 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:02.755780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:02.760596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:02.771750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.774038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.775618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:02.777292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.778839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.780616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:02.870047 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-140e4eac-6bd9-4dac-9cc2-0fc9ea1093ed tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121734 Aug 29 22:47:02.871347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 395/794] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:02 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:02.988320 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:02.989246 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:02.996993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.997484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.997942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:02.998834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.999310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.999986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.200837 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:03.212827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:03.214517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:03.215768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-85d8eead-104c-45e8-afe0-bb9860ae2015 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.233167 Aug 29 22:47:03.216339 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 400/795] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:02 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:03.568067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:03.569294 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:03.576516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.577101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.577653 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.578592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.579868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.580359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.615195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-295e5367-94a1-4704-b344-c92d7aad42bf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/ips" status: 200 len: 149 microversion: 2.1 time: 0.052460 Aug 29 22:47:03.616218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 396/796] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:47:03 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:03.887610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:03.890098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:03.902787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.902787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.902787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.902787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.903814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.904359 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.962140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-150dfa51-bc0c-4972-958b-77cf1d86acf0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081890 Aug 29 22:47:03.970109 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 401/797] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:03 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:04.243017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:04.243953 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:04.252824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:04.253766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:04.254448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:04.255875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:04.256744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:04.257559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:04.477909 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.487203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.488942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.490126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-dbf25e2f-d138-4349-815d-54ca28742127 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.252026 Aug 29 22:47:04.502998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 397/798] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:04 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:04.984352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:04.988401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:04.997164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:04.998186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:04.998930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:04.999952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.000656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.002206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.070647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c1981952-37d1-49f6-ab67-f9d61e6420c1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095671 Aug 29 22:47:05.072343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 402/799] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:04 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:05.246069 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1923009-f7aa-4a4c-9cbd-3e237c6a44ea"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:05.248394 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:05.255707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.256610 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.257250 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.258686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.259570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.260165 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.522250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:05.523776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:05.533203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.534423 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.539748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.541422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.542052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.542838 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.760008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.776026 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.777409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.778909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c8b3c431-1167-4a35-b487-c4531988fcbf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.267747 Aug 29 22:47:05.804992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 403/800] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:05 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:05.887633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4d6996ea-cbb7-498d-a496-d52644010f96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "POST /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647146 Aug 29 22:47:05.888739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 398/801] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:47:05 2022] POST /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:06.090505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:06.094574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:06.104771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.105491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.106043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:06.106871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.107567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.108404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:06.132779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:06.150991 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6854c0eb-756f-4757-8b3a-6ebd02bd85a0 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066914 Aug 29 22:47:06.152000 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 404/802] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:06 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:06.811970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:06.814046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:06.825395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.826261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.826937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:06.828103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.830043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.830696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.026938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.052642 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.056582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.059169 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5abacc38-c2c6-40a7-8bd2-a097fc3c1bbd tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1737 microversion: 2.20 time: 0.252620 Aug 29 22:47:07.060300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 399/803] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:06 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:07.167314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:07.169828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:07.178428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.179229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.179885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.180662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.181114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.181726 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.220238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-98f4a709-c61d-4930-85e8-093c6ab57deb tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057723 Aug 29 22:47:07.221006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 405/804] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:07 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:07.484248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:07.489676 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:07.500731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.502170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.503050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.504484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.505292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.506196 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.548599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5f9ccbc2-25ea-4062-b137-54e543fc352b tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077917 Aug 29 22:47:07.549259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 400/805] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:07 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:07.697889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:07.698681 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:07.706323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.706829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.707265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.708064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.708513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.709134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.746294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-895e7e5b-28f1-461a-8004-d1b3aed79280 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991" status: 200 len: 194 microversion: 2.1 time: 0.055704 Aug 29 22:47:07.748469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 406/806] 10.222.0.77 () {58 vars in 1413 bytes} [Mon Aug 29 22:47:07 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:07.760391 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:07.760885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:07.767356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.767841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.768272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.768977 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.769429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.769847 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.876877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'services' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:07.964239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-24e1ef1e-84d9-43f0-bbf5-c1913b86262e tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991" status: 202 len: 0 microversion: 2.1 time: 0.207774 Aug 29 22:47:07.964877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 401/807] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:07 2022] DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/c7cb2dd4-86b6-44ac-a333-477cbee03991 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:08.105805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:08.106910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:08.116978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.117585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.117915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.118714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.119736 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.120462 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.242032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:08.245792 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:08.255736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.256153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.256649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.257592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.258026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.258456 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.262991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:08.301595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c56bfbd9-4ed1-4591-9140-ce50565e0a8d tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066332 Aug 29 22:47:08.302338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 402/808] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:08 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:47:08.326998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.341417 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.344355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.346524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-586ca60f-993d-41e2-9fa9-1f99bf13b815 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1719 microversion: 2.20 time: 0.248077 Aug 29 22:47:08.354979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 407/809] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:08 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:08.421836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:08.422396 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:08.430665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.431220 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.431631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.432388 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.432848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.433277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.473304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:08.575927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f4fc7c5e-1942-43f1-a13c-347458266c33 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 204 len: 0 microversion: 2.1 time: 0.158387 Aug 29 22:47:08.576856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 403/810] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:08 2022] DELETE /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:47:08.586771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:08.587523 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:08.594526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.595625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.596020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.596931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.597562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.598267 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.800840 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.810188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b08d8472-f049-4942-8e08-ff6604027e15 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1690 microversion: 2.1 time: 0.227467 Aug 29 22:47:08.810814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 408/811] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:08 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:09.385317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:09.386026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:09.392578 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.393064 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.393502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:09.394241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.394696 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.395163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:09.581263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.592751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.595652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.596925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7df639f9-7cc0-461e-8ced-bee8b570c274 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1719 microversion: 2.20 time: 0.215969 Aug 29 22:47:09.597516 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 404/812] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:09 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:09.834483 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:09.835491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:09.842015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.842496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.843244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:09.843986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.844444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.845439 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:10.013806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:10.023282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-44458e44-ec8d-422c-a1dd-732ac901a928 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1690 microversion: 2.1 time: 0.192606 Aug 29 22:47:10.023865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 409/813] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:09 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1690 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:10.626852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:10.627795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:10.639384 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:10.640226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:10.640982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:10.642711 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:10.643557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:10.644312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:10.830858 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:10.847099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:10.849016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:10.850185 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c995fa03-6ada-4267-b5a8-ac51771ab502 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1719 microversion: 2.20 time: 0.231245 Aug 29 22:47:10.850772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 405/814] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:10 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:11.047704 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:11.048311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:11.057389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.058015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.058701 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:11.059972 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.060738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.061397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:11.268600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:11.276943 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1c3e233d-67f6-47ae-acb8-8c796ee93864 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1690 microversion: 2.1 time: 0.233361 Aug 29 22:47:11.277526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 410/815] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:11 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:11.890423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:11.891066 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:11.902179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.903110 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.903890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:11.905181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.906014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.906770 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.081988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.091310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.093261 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.094489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c0aee375-f38a-4b45-b020-901c473a667b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1719 microversion: 2.20 time: 0.210712 Aug 29 22:47:12.095142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 406/816] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:11 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1719 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:12.299941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:12.300881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:12.308066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:12.308406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:12.308990 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.309708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:12.310170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:12.310600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.500560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.512527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1ee94448-6005-4ea2-85a1-96ce7bd6c1cc tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1690 microversion: 2.1 time: 0.216592 Aug 29 22:47:12.513705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 411/817] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:12 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:12.894927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "name": "network-vif-unplugged", "status": "completed", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:12.909568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:12.910335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:12.911085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.930338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] Creating event network-vif-unplugged:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:47:12.940471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-7ad4a6e2-588b-4920-90be-f5e1933fa46a req-3cc002fc-9021-4d5d-96e8-b7ec74f5c674 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050307 Aug 29 22:47:12.942878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 407/818] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:13.123840 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:13.125248 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:13.136931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.137866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.138694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.140024 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.140899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.141731 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.338311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.347978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.349441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.350625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-777eb578-a837-4743-b055-e97d98928e05 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1719 microversion: 2.20 time: 0.234347 Aug 29 22:47:13.351310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 412/819] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:13 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:13.541495 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:13.543127 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:13.555688 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.556487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.557072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.557960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.558473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.558941 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.779275 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.788962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f8849def-2e43-42e2-9544-fdbe663773ea tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1690 microversion: 2.1 time: 0.253545 Aug 29 22:47:13.790193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 408/820] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:13 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:14.390252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:14.391321 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:14.403076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.403786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.404500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.405574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.406084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.406555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.701397 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.728642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.733237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.735879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dc67472c-b159-4ebd-ae99-b5461de3a2d2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1722 microversion: 2.20 time: 0.352011 Aug 29 22:47:14.736811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 413/821] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:14 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:14.781386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c232492-6175-412c-8526-5a3153e22ba6"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:14.785623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:14.797148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.799043 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.800080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.802246 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.803325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.804242 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.844571 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e14e21-0dac-42c8-8199-204b86564f96", "name": "network-vif-deleted", "tag": "259511c7-e40b-41e5-bde9-5641c0bc2d52"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:14.866533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.867172 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.867693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.885762 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] Creating event network-vif-deleted:259511c7-e40b-41e5-bde9-5641c0bc2d52 for instance 10e14e21-0dac-42c8-8199-204b86564f96 on hv-cinder-85427 Aug 29 22:47:14.894848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-4258ba08-b03e-4f92-89fa-771350404e32 req-ff0eb376-592c-48c3-97f3-e80eef0e1fdd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264015 Aug 29 22:47:14.900056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 409/822] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:14.914133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:14.915891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:14.925963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.926816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.927524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.928647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.929583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.930288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.097759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:15.109364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e5854845-c832-4836-b66b-97f423b87180 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 200 len: 1331 microversion: 2.1 time: 0.206560 Aug 29 22:47:15.116990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 410/823] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:14 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:15.387531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:15.388264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:15.396746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.397229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.398083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.399473 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.400284 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.400958 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.558426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'services' on Instance uuid 0c9ef285-a525-42c1-a3b3-eb2383a04797 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:15.626277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-81375583-7006-4490-b2e3-bf763a61f1ce tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.851669 Aug 29 22:47:15.628601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 414/824] 10.222.0.77 () {62 vars in 1364 bytes} [Mon Aug 29 22:47:14 2022] POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments => generated 188 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:47:15.680578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:15.681128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:15.702291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.703228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.708073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.709956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.713364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.716165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.722411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-83dbbea3-58fe-46cb-ad15-842170b35d27 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments/c1923009-f7aa-4a4c-9cbd-3e237c6a44ea" status: 202 len: 0 microversion: 2.1 time: 0.344013 Aug 29 22:47:15.724846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 411/825] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:15 2022] DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments/c1923009-f7aa-4a4c-9cbd-3e237c6a44ea => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:15.750375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:15.760743 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:15.799006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.799930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.800727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.802001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.802790 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-21d60448-1f78-43fe-a308-3a4271ba1d66 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/1bca4c55-d3b9-44dc-b893-02ac4b665ea0" status: 200 len: 194 microversion: 2.1 time: 0.127092 Aug 29 22:47:15.803070 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.803784 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.813182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 415/826] 10.222.0.77 () {58 vars in 1413 bytes} [Mon Aug 29 22:47:15 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/1bca4c55-d3b9-44dc-b893-02ac4b665ea0 => generated 194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:15.838680 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:15.839728 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:15.861009 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.864906 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.867034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.875564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.878847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.878847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.915243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-001902ee-74fa-4090-8836-97e1db569fd8 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181309 Aug 29 22:47:15.916903 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 412/827] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:15 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:16.023600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.024577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.035815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.036835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.037758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.038973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.039682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.040372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.101819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'services' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:16.233305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e13da894-5ddd-4fe3-bec6-3a9db6bdb582 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/1bca4c55-d3b9-44dc-b893-02ac4b665ea0" status: 202 len: 0 microversion: 2.1 time: 0.417363 Aug 29 22:47:16.234253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 416/828] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:15 2022] DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments/1bca4c55-d3b9-44dc-b893-02ac4b665ea0 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:16.253786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.254694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 10e14e21-0dac-42c8-8199-204b86564f96] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.265863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.267047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.267787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.268698 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.269788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.271702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.312122 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] HTTP exception thrown: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Request method failure captured: Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 HTTP/1.1 Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUDPMUFH2PrfWVx5qSdxVYWft2KxPLMI2cOV9TV7arGTPNVZ3nWwucj-36kRePsg1Fef1-K2zRx6d9OPNV8AChtC5q5Wmn2xPqUU24fb00xGE_V2vrZAw9jPIXaPBuUl9-Bw6lP25Gx513vnRr-G1PUTGZV5BHG2QrHmAm5z3WJVxRg Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:16.315052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_8ad722485ac34d1796f03003fbcde07a", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}] Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 8b46b3fa1df24c80ab7315c4ff44c064 Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. Aug 29 22:47:16.317717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '10e14e21-0dac-42c8-8199-204b86564f96'} Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:16.319284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. Aug 29 22:47:16.323233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:16.325830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Returning 404 to user: Instance 10e14e21-0dac-42c8-8199-204b86564f96 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:16.325830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-669548e7-d537-4b4f-88c3-7a5036207a5a tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96" status: 404 len: 111 microversion: 2.1 time: 0.081688 Aug 29 22:47:16.325830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 417/829] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:16 2022] GET /compute/v2.1/servers/10e14e21-0dac-42c8-8199-204b86564f96 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:16.333207 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-65261e5e-1465-46ac-a93e-a902b1ab4a03 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '.version_select at 0x7f5cf6ba4a60>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.372651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-65261e5e-1465-46ac-a93e-a902b1ab4a03 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003597119" status: 202 len: 0 microversion: 2.1 time: 0.042643 Aug 29 22:47:16.379829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 418/830] 10.222.0.77 () {58 vars in 1221 bytes} [Mon Aug 29 22:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003597119 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:16.487311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-309a2651-0734-465e-9f04-17f9ffa0f2f9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments/4c232492-6175-412c-8526-5a3153e22ba6" status: 202 len: 0 microversion: 2.20 time: 0.471500 Aug 29 22:47:16.489042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 413/831] 10.222.0.77 () {60 vars in 1457 bytes} [Mon Aug 29 22:47:16 2022] DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments/4c232492-6175-412c-8526-5a3153e22ba6 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:47:16.597026 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:16.597964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.609311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.610669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.611766 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.613092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.614140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.615033 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.651878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:16.694367 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=148457) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:47:16.810473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3184cb0b-4992-4325-8b9e-587f077165eb tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/action" status: 202 len: 0 microversion: 2.20 time: 0.219682 Aug 29 22:47:16.816626 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 419/832] 10.222.0.77 () {62 vars in 1319 bytes} [Mon Aug 29 22:47:16 2022] POST /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:47:16.824546 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.825410 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.837547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.838651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.839380 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.840436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.841326 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.842189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.939948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.952165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.985684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.986200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.986643 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.987390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.987855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.988285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.095854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-59210bb2-9abc-458a-a9f3-c16c73ae4d3c tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166466 Aug 29 22:47:17.098911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 420/833] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:16 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797/os-volume_attachments => generated 25 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:47:17.242111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:17.243181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:17.252894 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:17.253853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:17.254531 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.255553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:17.256231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:17.256828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.286904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.298781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:17.300620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.303542 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.305194 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d0cf9184-e98e-43e8-b9d8-e78a2f9bfdf2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1670 microversion: 2.20 time: 0.486711 Aug 29 22:47:17.306270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 414/834] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:16 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1670 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:17.476211 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c622a63e-2c5e-42d6-9f47-a75cdc9d3d7f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 204 len: 0 microversion: 2.1 time: 0.238439 Aug 29 22:47:17.478124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 421/835] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:17 2022] DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:47:17.488182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:17.488735 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:17.496035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:17.511137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:17.512297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.513710 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:17.514572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:17.515353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.524632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:17.745307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.754326 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ffca2dee-1543-4802-8366-dae924129c4f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1681 microversion: 2.1 time: 0.270408 Aug 29 22:47:17.755059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 415/836] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:17 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:18.339807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:18.341109 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:18.352301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.352922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.353421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.354265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.354792 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.355331 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.542175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.550747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.552400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.553723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b4d68bfc-d4ae-461e-b1f9-49067dfe90f3 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1670 microversion: 2.20 time: 0.222175 Aug 29 22:47:18.555525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 422/837] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:18 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:18.689235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:18.692447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:18.702323 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.703206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.703648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.704413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.705060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.705984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.753545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d14f0c39-29f1-4068-9aad-e479abd8131c tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068734 Aug 29 22:47:18.754134 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 416/838] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:18 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:47:18.785169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:18.786532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:18.795426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.796497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.797789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.800567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.801336 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.802077 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.986637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:18.991471 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:19.000937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.002369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.003007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.004112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.004740 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.005393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.070582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.083847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4d635fd8-4def-457e-9ff7-4359ba15e1a5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1681 microversion: 2.1 time: 0.305237 Aug 29 22:47:19.084428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 423/839] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:18 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:19.106946 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f165a00c-dd4f-4549-85d3-e4411c38fdd2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140575 Aug 29 22:47:19.108077 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 417/840] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:47:18 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:47:19.214842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:19.215646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:19.230320 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.231162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.232228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.233874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.234796 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.236643 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.290510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:19.418852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-464d7380-9f44-46f0-a586-f8258c2e0652 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 204 len: 0 microversion: 2.1 time: 0.208664 Aug 29 22:47:19.421452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 424/841] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:19 2022] DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:47:19.433302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:19.434040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:19.441199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.441690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.442339 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.443060 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.443477 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.444083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.588277 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:19.590219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:19.601909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.603195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.603980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.605236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.606240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.607038 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.624297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.640835 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-74903a1c-3778-4f68-9afd-9959d8bbefe6 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1673 microversion: 2.1 time: 0.212906 Aug 29 22:47:19.642299 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 418/842] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:19 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:19.793148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.807396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.809448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.811486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e2b2a7e3-f0d8-4643-998c-f5d89cf43e00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.232994 Aug 29 22:47:19.812864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 425/843] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:19 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:20.119199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.120501 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.132922 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.133703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.134314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.135657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.136574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.137428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.203266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.203690 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.212082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.213153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.214128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.215661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.216532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.217316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.263670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:20.273777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:20.274887 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4a1bdf7a-da59-40db-9e60-243505c2c06b tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1613 microversion: 2.1 time: 0.163594 Aug 29 22:47:20.275566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 419/844] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:20 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:20.416897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-049b6db5-6066-474d-a8d7-4218f2ee60ae tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 204 len: 0 microversion: 2.1 time: 0.217218 Aug 29 22:47:20.418066 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 426/845] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:20 2022] DELETE /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:47:20.428615 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.429238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.436372 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.436895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.437313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.438057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.439092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.439528 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.619137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9ef285-a525-42c1-a3b3-eb2383a04797", "name": "network-vif-deleted", "tag": "fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:20.631809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.632356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.633467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.647786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] Creating event network-vif-deleted:fa5d2fc6-40ca-4c5b-a322-aeca1ba8a559 for instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 on hv-cinder-85427 Aug 29 22:47:20.654194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-27441a08-edf2-4872-b875-d3fca9379634 req-aa189757-2a7d-4bd0-abc7-56ed1bcd55bf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043085 Aug 29 22:47:20.657822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 427/846] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:20.663520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:20.667413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.668376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.674335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b37ef267-797c-42b4-9d47-54a868a85297 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1506 microversion: 2.1 time: 0.249438 Aug 29 22:47:20.675845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 420/847] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:20 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:20.677512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.683410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.683410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.683410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.683410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.684047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.851781 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.853361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.864494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.865007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.866373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.867162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.867639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.868073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.989422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.003463 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-21a6cd42-5d26-4130-a121-aeb296f74586 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1673 microversion: 2.1 time: 0.341121 Aug 29 22:47:21.016940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 428/848] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:20 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1673 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:21.074583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.090147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.093298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.095598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-48e70eb7-9a90-4fe4-b850-d0c833ae0d2b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.250223 Aug 29 22:47:21.096782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 421/849] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:20 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:21.309289 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:21.309914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:21.316772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.317298 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.317781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.318704 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.319288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.319856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.397980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.409157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-76382cdc-8884-4077-ab2e-0e32ae6dcd36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1326 microversion: 2.1 time: 0.103788 Aug 29 22:47:21.409738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 429/850] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:21 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:21.712514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:21.713780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:21.726579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.727376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.728126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.729286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.730126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.730952 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.901996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.910980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-be27e198-35dd-4fe5-93e5-0fc23632261f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1506 microversion: 2.1 time: 0.205509 Aug 29 22:47:21.911960 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 422/851] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:21 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:22.026136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:22.027160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:22.034439 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.034992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.035427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.036124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.036573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.037003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.123735 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:22.124411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:22.135149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.135715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.136259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.137288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.138027 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.138749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.201269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:22.208670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:22.221188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3a0de751-f5be-4d4f-b064-60f0e6894022 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1673 microversion: 2.1 time: 0.200492 Aug 29 22:47:22.222062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 430/852] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:22 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:22.296673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:22.305572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:22.307038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:22.308203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-200a7995-0d42-495b-8eaf-ed8dfed9ed48 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.188726 Aug 29 22:47:22.308771 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 423/853] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:22 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:22.431288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:22.431817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:22.439936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.440453 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.440957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.441729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.442212 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.442658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.520951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:22.534902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9a2ea320-1827-4db1-98ad-1064b64d0d91 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1326 microversion: 2.1 time: 0.108153 Aug 29 22:47:22.535593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 431/854] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:22 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:22.936157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:22.937081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:22.944752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.945235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.945663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.946842 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.947265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.152862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.161245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-cd3a351c-4502-4416-ad47-e2f0b1fbabb4 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1506 microversion: 2.1 time: 0.231216 Aug 29 22:47:23.161832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 424/855] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:22 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:23.255997 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:23.256794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:23.274054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.275227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.276372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.277708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.279203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.280462 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.345950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:23.347206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:23.358488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.360773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.361272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.362332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.363488 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.364158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.579843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.590271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.604233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ad7868d4-033a-4e21-8463-839ac71fb269 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1673 microversion: 2.1 time: 0.342959 Aug 29 22:47:23.606099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.607891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.609387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1d78b7c8-aa7a-433f-a891-f8856e3f8456 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.270269 Aug 29 22:47:23.610678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 425/856] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:23 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:23.623757 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:23.626248 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:23.627437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 432/857] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:23 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1673 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:23.637514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.638883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.640023 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.642812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.644233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.645769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.706263 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:23.707650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:23.709724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.710702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lazy-loading 'fault' on Instance uuid 0c9ef285-a525-42c1-a3b3-eb2383a04797 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:23.990077 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7aa14777ab43a083b3a120c4349d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcb391184b94306898e43379094e5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:24.006897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f1b5bf14-4a86-49e4-bfd3-db747c7d7b36 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 200 len: 1331 microversion: 2.1 time: 0.393853 Aug 29 22:47:24.007872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 426/858] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:23 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:24.188973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:24.190083 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:24.200771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.201610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.202376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.206202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.207672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.208784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.289380 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc18feed-7dc2-459c-a709-7ac2d882f719", "name": "network-vif-deleted", "tag": "be00f065-5f4e-4890-b580-124b491dda4a"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:24.325298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.325988 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.326619 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.362358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] Creating event network-vif-deleted:be00f065-5f4e-4890-b580-124b491dda4a for instance cc18feed-7dc2-459c-a709-7ac2d882f719 on hv-cinder-85427 Aug 29 22:47:24.368898 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-2a978b4c-f8ac-42a3-90dd-ef7e4d6ee342 req-f57341de-e2e7-457a-b8ef-a4e30b81aff5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089573 Aug 29 22:47:24.369438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 427/859] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:24.410374 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:24.424079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2f4b6b69-95d3-46ce-bef1-d9236643cfd1 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 200 len: 1464 microversion: 2.1 time: 0.243386 Aug 29 22:47:24.425568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 433/860] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:24 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:24.647373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:24.648608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:24.659548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.667646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:24.668803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:24.670968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.674155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.675481 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.676291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.677046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.695047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.696431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.697185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.698469 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.699296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.708978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.104622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.107908 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.119652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-108c7b80-b34f-47e2-9e98-268eee333ea4 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1673 microversion: 2.1 time: 0.477171 Aug 29 22:47:25.120414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 428/861] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:24 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1673 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:25.133512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.136418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.138023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8d2c31d0-611b-4929-bb1d-b0ca5c79416d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.475719 Aug 29 22:47:25.154887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 434/862] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:24 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:25.155186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:25.155186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:25.158452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.159901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.160637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.164457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.166322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.167322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.200024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 HTTP/1.1 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:25.209087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:25.212418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '0c9ef285-a525-42c1-a3b3-eb2383a04797'} Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:25.215073 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:25.218383 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.220579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:25.220579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6075c887-7d30-42f4-a797-d1a8f28d5c0a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 404 len: 111 microversion: 2.1 time: 0.092537 Aug 29 22:47:25.220579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 429/863] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:25 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:25.231097 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4849a1d4-bb8c-4bb9-812b-bbae15f943cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '.version_select at 0x7f5cf6be6ee0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:25.245776 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:25.268916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4849a1d4-bb8c-4bb9-812b-bbae15f943cf tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626488824" status: 202 len: 0 microversion: 2.1 time: 0.044969 Aug 29 22:47:25.273496 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 435/864] 10.222.0.77 () {58 vars in 1218 bytes} [Mon Aug 29 22:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626488824 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:25.661366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:25.661996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: cc18feed-7dc2-459c-a709-7ac2d882f719] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:25.685104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.685104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.693108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.694312 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.705276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.710961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.776799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] HTTP exception thrown: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Request method failure captured: Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 HTTP/1.1 Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUDPMUFH2PrfWVx5qSdxVYWft2KxPLMI2cOV9TV7arGTPNVZ3nWwucj-36kRePsg1Fef1-K2zRx6d9OPNV8AChtC5q5Wmn2xPqUU24fb00xGE_V2vrZAw9jPIXaPBuUl9-Bw6lP25Gx513vnRr-G1PUTGZV5BHG2QrHmAm5z3WJVxRg Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:25.784905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_8ad722485ac34d1796f03003fbcde07a", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}] Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 8b46b3fa1df24c80ab7315c4ff44c064 Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. Aug 29 22:47:25.788198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': 'cc18feed-7dc2-459c-a709-7ac2d882f719'} Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:25.789724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. Aug 29 22:47:25.794133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:25.798149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Returning 404 to user: Instance cc18feed-7dc2-459c-a709-7ac2d882f719 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:25.798149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-96b6f783-8bf6-41a3-894b-87a3c8a47290 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719" status: 404 len: 111 microversion: 2.1 time: 0.341225 Aug 29 22:47:25.800136 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 430/865] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:25 2022] GET /compute/v2.1/servers/cc18feed-7dc2-459c-a709-7ac2d882f719 => generated 111 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:25.837743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:25.838430 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:25.858019 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.858908 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.859913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.862961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.864843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.866705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.163442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:26.168291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:26.196413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.197746 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.200164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.204418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.205266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.209288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.215170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:26.291636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.292407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.293013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.293633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:26.365785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:26.379436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-df6129c1-4d90-4a61-9c39-e098b3ecbffb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.224190 Aug 29 22:47:26.382361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 431/866] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:26 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:26.392965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:26.395486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-53397125-60b2-446c-9209-de39c33bc98f tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 204 len: 0 microversion: 2.1 time: 0.582016 Aug 29 22:47:26.396434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:26.397387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 436/867] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:25 2022] DELETE /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:47:26.414295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.416659 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.417980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.419984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.421902 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.425486 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.434409 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:26.456881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:26.487744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.488686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.490854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.494199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.495269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.498025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.054141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.074890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.078188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.081648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9b6b30c3-a87e-4e1a-893c-52aac8637054 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.697658 Aug 29 22:47:27.083181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 432/868] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:26 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:27.093565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f91121-8c3c-48c9-ac28-a04ee9f1884d", "name": "network-vif-deleted", "tag": "20742b6f-8340-4fe9-a393-9ada56f123b0"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:27.115267 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.116264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.117019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.124265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.146628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-feb99117-7bd3-43e2-ab50-409d96eaf009 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.723837 Aug 29 22:47:27.148738 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 437/869] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:26 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:27.151237 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:27.154779 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] Creating event network-vif-deleted:20742b6f-8340-4fe9-a393-9ada56f123b0 for instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d on hv-cinder-85427 Aug 29 22:47:27.167959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-7c7c9683-c24f-48df-98f9-5230d6cac124 req-5a6701d8-6c08-49c2-ad8d-9090d507ba40 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082641 Aug 29 22:47:27.168952 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 433/870] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:27.421788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:27.422879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:27.433916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.434534 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.435011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.435897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.436556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.437081 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.485123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.485979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.486806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.487562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:27.538883 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.553120 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-14604620-967b-440c-b596-c36ffc425c28 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.136310 Aug 29 22:47:27.554153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 438/871] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:27 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:28.121721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:28.122496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:28.130519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.131201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.131773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.132553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.133081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.133583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.181751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:28.182644 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:28.190096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.190609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.191101 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.191829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.192383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.192821 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.469800 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:28.483936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:28.486883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:28.488992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-08e3d87a-953d-4994-b351-2e620a99d96c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.371889 Aug 29 22:47:28.490044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 434/872] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:28 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:28.494955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:28.498001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:28.498896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:28.509808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.510354 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.510525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c6fcacdd-7c07-4187-a974-6ece2471aa39 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.332365 Aug 29 22:47:28.510885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.511328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 439/873] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:28 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:28.511541 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.512026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.512452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.527436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 HTTP/1.1 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:28.529096 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.532401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '0c9ef285-a525-42c1-a3b3-eb2383a04797'} Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:28.534068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.536614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.538990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:28.538990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2db920ea-2095-44ce-83c4-ec45fb243f72 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 404 len: 111 microversion: 2.1 time: 0.039004 Aug 29 22:47:28.538990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 435/874] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:28 2022] DELETE /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:28.540158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:28.540823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 0c9ef285-a525-42c1-a3b3-eb2383a04797] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:28.547914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.548410 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.548851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.549580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.550026 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.550460 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.565091 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 HTTP/1.1 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:28.567040 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.569513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '0c9ef285-a525-42c1-a3b3-eb2383a04797'} Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:28.571285 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. Aug 29 22:47:28.573769 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:28.576536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 0c9ef285-a525-42c1-a3b3-eb2383a04797 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:28.576536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-727b252a-3e8a-4e60-8ca0-05fd0f55d25f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797" status: 404 len: 111 microversion: 2.1 time: 0.032818 Aug 29 22:47:28.576536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 440/875] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:28 2022] GET /compute/v2.1/servers/0c9ef285-a525-42c1-a3b3-eb2383a04797 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:28.582974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:28.583883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:28.591195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.591845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.592432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.595178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.595178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.595871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.642560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:28.649465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:28.649966 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:28.650411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:28.650905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:28.725154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:28.738203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d01d0ff4-1d1d-4732-912b-323e3cb4d2bb tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.159840 Aug 29 22:47:28.739072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 436/876] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:28 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:29.519624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:29.521777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:29.543082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:29.543904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:29.543904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:29.545001 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:29.545589 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:29.546582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:29.548274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:29.549115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:29.563413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:29.565440 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:29.566287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:29.567660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:29.568574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:29.569424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:29.945046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:29.951329 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:29.965266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:29.966401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-31eaf518-37cf-441f-b65f-29eaf1df9b90 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.431035 Aug 29 22:47:29.981952 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:29.983776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 437/877] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:29 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:29.996562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7767f8cb-5c65-4edd-bda6-89fd64e70d00 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.470856 Aug 29 22:47:29.996562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 441/878] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:29 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:30.004239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.007466 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.009115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.013064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.029344 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.032534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.033598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.034568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.035996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.037199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.038247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.039331 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.040377 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.041881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.051087 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.052181 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.108142 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 HTTP/1.1 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:30.110623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.112848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6'} Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:30.114247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.115815 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.117548 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:30.118564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a8081085-0eea-4c4a-8d53-08546557cf96 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 404 len: 111 microversion: 2.1 time: 0.126583 Aug 29 22:47:30.119249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 442/879] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:29 2022] DELETE /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:30.126050 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.127284 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.128086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.128362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.128981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.129145 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:30.137044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.137489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.137922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.145960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.146930 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.147751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.200252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 HTTP/1.1 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:30.202688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.206356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6'} Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:30.207966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. Aug 29 22:47:30.210970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.215117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:30.215117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d8ca26bc-3709-4416-bc1c-8f5d733cc0c5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6" status: 404 len: 111 microversion: 2.1 time: 0.081480 Aug 29 22:47:30.215618 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:30.215889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 443/880] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:30 2022] GET /compute/v2.1/servers/c2ea4fc1-4a67-46e4-b158-f3fb17a9b1a6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:30.220383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.221096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.230663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6b89bef4-b940-4a47-aed2-eebffd63ff10 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.245022 Aug 29 22:47:30.232940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.233789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.234599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.235927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.236755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.237506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.244582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 438/881] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:29 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:30.262170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a HTTP/1.1 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:30.263852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.267265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '5dd5423a-56bc-4eb2-8285-f32a236db67a'} Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:30.268651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.271856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.274961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:30.274961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2137d1cc-4633-4f51-a10f-29009216fd2d tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 404 len: 111 microversion: 2.1 time: 0.051693 Aug 29 22:47:30.274961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 444/882] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:30 2022] DELETE /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:30.280670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.281552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: 5dd5423a-56bc-4eb2-8285-f32a236db67a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.292409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.293289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.294170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.295760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.296703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.297560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.323430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a HTTP/1.1 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:30.325338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.327880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '5dd5423a-56bc-4eb2-8285-f32a236db67a'} Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:30.329896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. Aug 29 22:47:30.333780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:30.338713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance 5dd5423a-56bc-4eb2-8285-f32a236db67a could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:30.338713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-760843e4-9837-4b39-b7e3-0b8780e3beb5 tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a" status: 404 len: 111 microversion: 2.1 time: 0.054769 Aug 29 22:47:30.338713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 439/883] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:30 2022] GET /compute/v2.1/servers/5dd5423a-56bc-4eb2-8285-f32a236db67a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:31.008580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.009773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.021427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.022666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.023387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.027310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.028258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.028969 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.032294 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.033955 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.045764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.046909 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.047669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.048684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.049423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.050153 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.370691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.373601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.388585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.392774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.395575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b61c79f7-4ef3-4488-88d3-df28378d126f tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.367403 Aug 29 22:47:31.396293 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-eb11e688-5143-46f8-af14-c8962db310a9 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.383862 Aug 29 22:47:31.406800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 445/884] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:30 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:31.414777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.415880 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.416686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 440/885] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:31 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:31.434276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.435111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.435751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.436652 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.437286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.438897 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.490282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.490728 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.491657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.493828 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:31.572915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.589647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b6e64276-b581-412a-8776-b7aac1563036 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.190640 Aug 29 22:47:31.591216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 446/886] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:31 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:31.614251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.615398 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.634855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.635364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.635802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.637406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.637962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.638685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.663704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e HTTP/1.1 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:31.666426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.668397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': 'e48a61e3-953a-41a2-a47f-96f40b362e3e'} Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:31.669457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.670822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.672205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:31.672205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-614c8596-0129-4f8a-acd3-8c0eb084496f tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 404 len: 111 microversion: 2.1 time: 0.061770 Aug 29 22:47:31.672205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 441/887] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:31 2022] DELETE /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:31.682199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.683529 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] [instance: e48a61e3-953a-41a2-a47f-96f40b362e3e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.693157 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.693849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.694401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.695290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.695871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.696401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.712024 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] HTTP exception thrown: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Request method failure captured: Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e HTTP/1.1 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCBJC6wwMZQ8eeiVpK8ntK5ywM58we5laqKC_wnI-pnug6tnPX0B5C-r9y_yd1EJqFMRDQx5Qr9-CfFAj1X60fMhkI480fH_GqxxxrYxyv2jlJlPHklK3usenqVPrvHt-_8qI0H8bZNp_eJ0QgSrL5a6zydfEteJUwoSoMsMj1uAmg Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:31.714655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/1fcb391184b94306898e43379094e5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_1fcb391184b94306898e43379094e5f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/1fcb391184b94306898e43379094e5f6"}]}] Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 1fcb391184b94306898e43379094e5f6 Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-92582572 Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: cc7aa14777ab43a083b3a120c4349d67 Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeNegativeTest-92582572-project Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.716376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'e48a61e3-953a-41a2-a47f-96f40b362e3e'} Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:31.717471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. Aug 29 22:47:31.720482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:31.722709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] Returning 404 to user: Instance e48a61e3-953a-41a2-a47f-96f40b362e3e could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:31.722709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1ff4ba56-3330-4069-b718-e894fbff924a tempest-AttachVolumeNegativeTest-92582572 tempest-AttachVolumeNegativeTest-92582572-project] 10.222.0.77 "GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e" status: 404 len: 111 microversion: 2.1 time: 0.042457 Aug 29 22:47:31.726333 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 447/888] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:31 2022] GET /compute/v2.1/servers/e48a61e3-953a-41a2-a47f-96f40b362e3e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:32.446108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:32.450650 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:32.452760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:32.454841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:32.483353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.489783 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.493454 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.495224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.495868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.497371 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.499667 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.500089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.501745 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.509877 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.511429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.512905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.926771 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:32.945824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-921b92cc-9a17-404c-a9c4-cd73ed3fb873 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.520326 Aug 29 22:47:32.958971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 442/889] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:32 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:32.966309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:32.966850 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:32.977602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.980592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.982035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.984039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.986658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.987777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.072108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.073026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.073926 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.074865 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:33.115878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.134768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.139072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.143376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9b668cb2-9651-4fec-ab0f-e50e9efe765c tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.711617 Aug 29 22:47:33.158831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 448/890] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:32 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:33.207828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.223998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9ee9ec69-f197-408e-ad11-ba4d87f45ab2 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.263165 Aug 29 22:47:33.225929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 443/891] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:32 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:33.976375 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:33.978513 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:33.991172 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.992539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.993590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.994625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.995364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.996021 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.022920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:34.184585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:34.185704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:34.205188 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.207984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.209287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.210399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.210976 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.211428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.554915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.570421 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7afa01c9-c9a3-4a27-89d8-74c4f936fb5c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.600141 Aug 29 22:47:34.582167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 449/892] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:33 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:34.607754 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:34.610119 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:34.635748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.636956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.638023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.642406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.644980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.647535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.700314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.717687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.737247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.757566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-95079466-a73d-4ae9-935f-fc8a95c6df6b tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.578097 Aug 29 22:47:34.768657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.769510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 444/893] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:34 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:34.769824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.770646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.771560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:34.997117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:35.009832 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-63443d86-f428-4306-8bd2-63d1571e4a08 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.425057 Aug 29 22:47:35.025960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 450/894] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:34 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:35.621498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:35.623840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:35.653698 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.659157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.660112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.661309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.663443 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.667244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.808548 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:35.810194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:35.845047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.845927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.846614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.848171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.849231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.849963 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.130004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.157708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fdfb213c-a292-4290-b418-16c333f84fb7 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.540671 Aug 29 22:47:36.207258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 445/895] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:35 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:36.225715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:36.226932 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:36.245030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.245895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.246695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.248010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.248843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.249515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.358294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.384113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.384818 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.385390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.386014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:36.392147 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.400732 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.406505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f2f06239-227c-4cf6-81bd-eb55336ebf91 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.602304 Aug 29 22:47:36.445990 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 451/896] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:35 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:36.547945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.584691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f10a7964-6681-4043-821b-19a58288269f tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.370974 Aug 29 22:47:36.587578 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 446/897] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:36 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:37.228527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:37.229162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:37.246524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.247201 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.247524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.248260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.248722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.249160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.460306 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.467652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:37.470603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:37.475614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5bf7a7a1-c847-4a11-9b61-446003d4bd5b tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.250723 Aug 29 22:47:37.483298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.484538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.485594 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.487071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.488493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.489482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.491284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 452/898] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:37 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:37.633684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:37.635079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:37.644412 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.645290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.646098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.647427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.648255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.649035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.679718 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.694667 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.697663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.700108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-705052d0-01d2-4656-b6b7-3fcd56cadedf tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.240044 Aug 29 22:47:37.707869 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 447/899] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:37 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:37.721730 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.722647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.723797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.724488 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lazy-loading 'fault' on Instance uuid 99f91121-8c3c-48c9-ac28-a04ee9f1884d {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:37.800994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70da750fbe764462b50dc0fcef3eb0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0dd257dea04aca845b17f51e1c200e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.816576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-385a0cb2-6c93-4d52-bb1f-4d8e3b101cee tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 200 len: 1327 microversion: 2.1 time: 0.189391 Aug 29 22:47:37.830130 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 453/900] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:37 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 1327 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:38.512674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:38.513812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:38.522991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.523546 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.524169 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.524654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.525142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.525740 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.733789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:38.734895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:38.750964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:38.757601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.758105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.758540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.759979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.761360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.762836 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.767183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3e241507-ad2c-4a3a-8801-0a90c58bb026 tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1521 microversion: 2.1 time: 0.261764 Aug 29 22:47:38.768325 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 448/901] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:38 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:38.857406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:38.863494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:38.887813 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.889846 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.891840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.895991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.900480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.901800 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.968736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d HTTP/1.1 Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:38.972029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:38.975115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '99f91121-8c3c-48c9-ac28-a04ee9f1884d'} Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:38.976700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:38.979590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.989951 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:38.989951 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-18f9de97-8e10-4d00-a2a8-028f1bc70017 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 404 len: 111 microversion: 2.1 time: 0.136966 Aug 29 22:47:38.989951 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 449/902] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:38 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:47:39.002703 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-29af8b4a-54a1-463e-bb52-20ecb911da2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '.version_select at 0x7f5cf6bec3a0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:39.056854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-29af8b4a-54a1-463e-bb52-20ecb911da2d tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403618343" status: 202 len: 0 microversion: 2.1 time: 0.067311 Aug 29 22:47:39.057693 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 450/903] 10.222.0.77 () {58 vars in 1221 bytes} [Mon Aug 29 22:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403618343 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:39.150068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:39.165774 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:39.169446 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:39.172807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0efec49d-b4cf-4234-aec5-f8d1cbf7b94d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.445426 Aug 29 22:47:39.174839 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 454/904] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:38 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:39.814997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:39.817707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:39.842019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:39.843207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:39.844947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:39.846656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:39.847739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:39.848672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:39.890686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e78f6ed-61b5-43c7-acd0-82d594ac1a2a", "name": "network-vif-deleted", "tag": "3ccec209-cbef-4789-bf99-1b161e07c449"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:39.907557 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:39.908560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:39.913176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:39.938625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] Creating event network-vif-deleted:3ccec209-cbef-4789-bf99-1b161e07c449 for instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a on hv-cinder-85427 Aug 29 22:47:39.946200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-eb64ebf5-5033-4d18-b379-9e81f415bd26 req-822b6297-dbc8-42e6-8127-694fc3e42890 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059744 Aug 29 22:47:39.951583 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 455/905] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:40.114056 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b46b3fa1df24c80ab7315c4ff44c064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad722485ac34d1796f03003fbcde07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:40.143713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5ec22cf4-2f25-47e1-875b-621c1884d11c tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 200 len: 1479 microversion: 2.1 time: 0.344595 Aug 29 22:47:40.145699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 451/906] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:39 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:40.223866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:40.225172 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:40.241134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:40.242341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:40.243422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:40.249020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:40.250470 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:40.254622 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:40.518598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:40.533974 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:40.536684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:40.538898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d3774c21-64ed-451c-b5cd-fcbef5f820a1 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.328321 Aug 29 22:47:40.556124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 456/907] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:40 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:41.096720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "name": "network-vif-plugged", "status": "completed", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:41.108510 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:41.109962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:41.110720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.129682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] Creating event network-vif-plugged:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:47:41.135753 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-b11c6b01-c32f-456d-896a-6b0ce0dd0ed5 req-86fcf38e-b351-4545-a5b4-1e3e01bb9629 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043826 Aug 29 22:47:41.136982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 452/908] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:41.174179 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:41.177873 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] [instance: 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:41.198332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:41.199486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:41.212125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.214986 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:41.215974 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:41.216768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.241592 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] HTTP exception thrown: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Request method failure captured: Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a HTTP/1.1 Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUDPMUFH2PrfWVx5qSdxVYWft2KxPLMI2cOV9TV7arGTPNVZ3nWwucj-36kRePsg1Fef1-K2zRx6d9OPNV8AChtC5q5Wmn2xPqUU24fb00xGE_V2vrZAw9jPIXaPBuUl9-Bw6lP25Gx513vnRr-G1PUTGZV5BHG2QrHmAm5z3WJVxRg Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:41.243810 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_8ad722485ac34d1796f03003fbcde07a", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/8ad722485ac34d1796f03003fbcde07a"}]}] Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 8ad722485ac34d1796f03003fbcde07a Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2027150672 Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 8b46b3fa1df24c80ab7315c4ff44c064 Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2027150672-project Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. Aug 29 22:47:41.256616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '9e78f6ed-61b5-43c7-acd0-82d594ac1a2a'} Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.261562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. Aug 29 22:47:41.270335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.272835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] Returning 404 to user: Instance 9e78f6ed-61b5-43c7-acd0-82d594ac1a2a could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.272835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e10dd0be-fcd1-42d0-bf6c-aa659425e6bd tempest-ServerRescueNegativeTestJSON-2027150672 tempest-ServerRescueNegativeTestJSON-2027150672-project] 10.222.0.77 "GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a" status: 404 len: 111 microversion: 2.1 time: 0.082154 Aug 29 22:47:41.272835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 457/909] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:41 2022] GET /compute/v2.1/servers/9e78f6ed-61b5-43c7-acd0-82d594ac1a2a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:47:41.481116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7719e965-23d6-4bc0-be65-a142785438c3 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Action: 'create', calling method: .version_select at 0x7f5cf6c8ef70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-818699965", "metadata": {"Type": "work"}}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7719e965-23d6-4bc0-be65-a142785438c3 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 121 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:41.490480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-818699965", "metadata": {"Type": "work"}}} Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: Aug 29 22:47:41.493368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-818699965', 'metadata': {'Type': 'work'}}}} Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.495014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:47:41.497534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:47:41.501356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:47:41.501356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.501356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7719e965-23d6-4bc0-be65-a142785438c3 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.501356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7719e965-23d6-4bc0-be65-a142785438c3 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.237648 Aug 29 22:47:41.501356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 453/910] 10.222.0.77 () {60 vars in 1156 bytes} [Mon Aug 29 22:47:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:47:41.517191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8ae05905-c589-4a91-83e7-7b8af25f4229 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Action: 'create', calling method: .version_select at 0x7f5cf6c27040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1176173360", "metadata": {"Type": "work"}}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8ae05905-c589-4a91-83e7-7b8af25f4229 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 120 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:41.523976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1176173360", "metadata": {"Type": "work"}}} Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:47:41.525686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1176173360', 'metadata': {'Type': 'work'}}}} Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi '0' Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.526637 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:47:41.528255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:47:41.529527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:47:41.529527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.529527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8ae05905-c589-4a91-83e7-7b8af25f4229 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.529527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8ae05905-c589-4a91-83e7-7b8af25f4229 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016314 Aug 29 22:47:41.533153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 458/911] 10.222.0.77 () {60 vars in 1156 bytes} [Mon Aug 29 22:47:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:47:41.541448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6430aa95-85ab-4a62-9070-9b834448c428 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Action: 'create', calling method: .version_select at 0x7f5cf6c32af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1404636964", "metadata": {"Type": "work"}}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6430aa95-85ab-4a62-9070-9b834448c428 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 119 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:41.546560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1404636964", "metadata": {"Type": "work"}}} Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: Aug 29 22:47:41.548907 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1404636964', 'metadata': {'Type': 'work'}}}} Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi '' Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.556132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:47:41.560338 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:47:41.565283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:47:41.565283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.565283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6430aa95-85ab-4a62-9070-9b834448c428 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.565283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6430aa95-85ab-4a62-9070-9b834448c428 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013471 Aug 29 22:47:41.565283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 454/912] 10.222.0.77 () {60 vars in 1156 bytes} [Mon Aug 29 22:47:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:47:41.566905 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-03fd7a77-ef19-4bca-b1e7-c0d4e4373e6d tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Calling method '.version_select at 0x7f5cf6b92550>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:41.575239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:41.576569 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:41.584677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:41.584911 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:41.585395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.586102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:41.586554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:41.587013 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.599034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-03fd7a77-ef19-4bca-b1e7-c0d4e4373e6d tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] HTTP exception thrown: Volume tempest-invalid-320163443 could not be found. Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-03fd7a77-ef19-4bca-b1e7-c0d4e4373e6d tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-320163443 HTTP/1.1 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:41.601322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume tempest-invalid-320163443 could not be found. Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'tempest-invalid-320163443'} Aug 29 22:47:41.603003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-320163443 could not be found. (HTTP 404) (Request-ID: req-4944c377-4189-41f5-abb6-40f7f8b1d12d) Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.604060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:47:41.605533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-320163443 could not be found. Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:41.612787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-320163443 could not be found. Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-320163443 could not be found. Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-03fd7a77-ef19-4bca-b1e7-c0d4e4373e6d tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 404 to user: Volume tempest-invalid-320163443 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-03fd7a77-ef19-4bca-b1e7-c0d4e4373e6d tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-320163443" status: 404 len: 98 microversion: 2.1 time: 0.047710 Aug 29 22:47:41.615143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 459/913] 10.222.0.77 () {58 vars in 1215 bytes} [Mon Aug 29 22:47:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-320163443 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 22:47:41.617841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:41.619942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4878d4c6-ea23-4704-953f-f8f2f2f50c95 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007288 Aug 29 22:47:41.628489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 460/914] 10.222.0.77 () {58 vars in 1140 bytes} [Mon Aug 29 22:47:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 22:47:41.632713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-aee8e211-b941-4c9b-8143-ad617691f5c4 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003978 Aug 29 22:47:41.633584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 461/915] 10.222.0.77 () {58 vars in 1137 bytes} [Mon Aug 29 22:47:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 22:47:41.646572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-93dde437-1ed0-4d2e-9e82-1523720108e1 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Calling method '.version_select at 0x7f5cf6c27ca0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:41.684951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-93dde437-1ed0-4d2e-9e82-1523720108e1 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] HTTP exception thrown: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-93dde437-1ed0-4d2e-9e82-1523720108e1 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/os-volumes/5a44a1a1-9354-4371-8295-5fcecb3cf34e HTTP/1.1 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:41.687301 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '5a44a1a1-9354-4371-8295-5fcecb3cf34e'} Aug 29 22:47:41.696454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. (HTTP 404) (Request-ID: req-2545ffee-4895-4c37-8295-92ddf3df894e) Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.698300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:47:41.699941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:47:41.702141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-93dde437-1ed0-4d2e-9e82-1523720108e1 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 404 to user: Volume 5a44a1a1-9354-4371-8295-5fcecb3cf34e could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-93dde437-1ed0-4d2e-9e82-1523720108e1 tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/5a44a1a1-9354-4371-8295-5fcecb3cf34e" status: 404 len: 109 microversion: 2.1 time: 0.047918 Aug 29 22:47:41.707955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 462/916] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:47:41 2022] DELETE /compute/v2.1/os-volumes/5a44a1a1-9354-4371-8295-5fcecb3cf34e => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:47:41.712129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6954ea2-db43-4a5e-97a8-95d578ece75f tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Calling method '.version_select at 0x7f5cf6c27670>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:41.750585 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-c6954ea2-db43-4a5e-97a8-95d578ece75f tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] HTTP exception thrown: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6954ea2-db43-4a5e-97a8-95d578ece75f tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Request method failure captured: Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/os-volumes/d35a807b-4894-40a4-a681-96a20bde4ad1 HTTP/1.1 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUINXFF5yPHHutfmBnc6-WzIobJm6SaYMzIC4AmDNB2rUySELon4lOtSLmKAcE0pGAvUlTmZ4NlP6JmtEJCFxj7oUCHupgoKC0UsEMhxaxxoA6HpDSe-SsqiZLIDluzwKato_NFTcQKwKEv1mJdT7p1vfO5vq2Ea4MdacwqiiL3zU94 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:41.755922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e366a29135794c3c8d3a2a36d07c6bfb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e366a29135794c3c8d3a2a36d07c6bfb"}]}] Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: e366a29135794c3c8d3a2a36d07c6bfb Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesNegativeTest-1697195699 Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: e6c282c2cf3d4521b3a49d812d48e402 Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesNegativeTest-1697195699-project Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'd35a807b-4894-40a4-a681-96a20bde4ad1'} Aug 29 22:47:41.759095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. (HTTP 404) (Request-ID: req-9b67c80f-368d-4be0-8408-a63ef705b266) Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.760675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:47:41.763265 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:47:41.767095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c6954ea2-db43-4a5e-97a8-95d578ece75f tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] Returning 404 to user: Volume d35a807b-4894-40a4-a681-96a20bde4ad1 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c6954ea2-db43-4a5e-97a8-95d578ece75f tempest-VolumesNegativeTest-1697195699 tempest-VolumesNegativeTest-1697195699-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/d35a807b-4894-40a4-a681-96a20bde4ad1" status: 404 len: 109 microversion: 2.1 time: 0.058970 Aug 29 22:47:41.769588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 463/917] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:41 2022] GET /compute/v2.1/os-volumes/d35a807b-4894-40a4-a681-96a20bde4ad1 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:47:42.006101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:42.017014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:42.022452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:42.022452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1dba2e86-253c-4f2e-81f7-baf4fb54021e tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.452219 Aug 29 22:47:42.035147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 455/918] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:41 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:42.946240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:42.948129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:42.961593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.962844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.965581 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:42.967629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.969326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.970094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.003290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d HTTP/1.1 Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:43.005254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.008124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '99f91121-8c3c-48c9-ac28-a04ee9f1884d'} Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:43.010388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.014712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.018392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:43.018392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8956cd6c-1c91-4e8f-bdcc-f69a5ad668b7 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 404 len: 111 microversion: 2.1 time: 0.070664 Aug 29 22:47:43.018392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 464/919] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:42 2022] DELETE /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:43.022469 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:43.023399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 99f91121-8c3c-48c9-ac28-a04ee9f1884d] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:43.032179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.032769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.033283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.034075 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.035333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.035333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.057707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d HTTP/1.1 Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:43.061067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.064085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '99f91121-8c3c-48c9-ac28-a04ee9f1884d'} Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:43.065669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. Aug 29 22:47:43.067608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:43.074879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:43.074879 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:43.076205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 99f91121-8c3c-48c9-ac28-a04ee9f1884d could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:43.076205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-23806c69-4e0d-4f19-842e-d8ca5006f8b5 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d" status: 404 len: 111 microversion: 2.1 time: 0.049149 Aug 29 22:47:43.076205 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 456/920] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:43 2022] GET /compute/v2.1/servers/99f91121-8c3c-48c9-ac28-a04ee9f1884d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:43.079938 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.083794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.084691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.086110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.086953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.087674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.473864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:43.489784 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:43.493142 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:43.495679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c9f53f89-ce08-4002-a863-a1052fd89338 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1728 microversion: 2.20 time: 0.447006 Aug 29 22:47:43.497492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 465/921] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:43 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1728 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:44.397052 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:44.398005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:44.410721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.411891 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.412797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.414622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.415749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.416705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.447963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b HTTP/1.1 Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:47:44.451566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.454332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '69f655b3-78d2-40f5-ac78-806952dba34b'} Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:44.455863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.458523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.465320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:44.465320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9e3c95a3-be00-45fd-b139-50ccfc67a4e8 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 404 len: 111 microversion: 2.1 time: 0.076017 Aug 29 22:47:44.465320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 457/922] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:44 2022] DELETE /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:44.476778 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:44.478052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] [instance: 69f655b3-78d2-40f5-ac78-806952dba34b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:44.490530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.491395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.492116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.493694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.494435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.496492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.519920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] HTTP exception thrown: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Request method failure captured: Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b HTTP/1.1 Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUB-up8Qdtrox49u3Zfl6tXu4K5TJGD1WOMddJaLvarYZ6Pa87RkhV1jilugmYLLLd6yJ3lSy7WCKcVTiL-z8EzWvwHdOIdykUMai6RKYEPdOcxBQIlOqjS81gKpDW_WojfCKXlUMzKHSVkCuNISkzxTMtrZd47VidKSHmf3FZANUBQ Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:44.522675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_cf0dd257dea04aca845b17f51e1c200e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/cf0dd257dea04aca845b17f51e1c200e"}]}] Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: cf0dd257dea04aca845b17f51e1c200e Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239573874 Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 70da750fbe764462b50dc0fcef3eb0e6 Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeTestJSON-239573874-project Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.525559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '69f655b3-78d2-40f5-ac78-806952dba34b'} Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:44.526956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. Aug 29 22:47:44.529020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:44.530967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] Returning 404 to user: Instance 69f655b3-78d2-40f5-ac78-806952dba34b could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:44.530967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3fba1873-e2a4-48b5-a173-fd79cb4f3336 tempest-AttachVolumeTestJSON-239573874 tempest-AttachVolumeTestJSON-239573874-project] 10.222.0.77 "GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b" status: 404 len: 111 microversion: 2.1 time: 0.054578 Aug 29 22:47:44.530967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 466/923] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:44 2022] GET /compute/v2.1/servers/69f655b3-78d2-40f5-ac78-806952dba34b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:44.538600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:44.539723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:44.548879 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.549686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.551606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.551606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.552251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.552721 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.274727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:45.291546 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:45.296865 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:45.299652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c29cbb31-806f-42db-91b3-141767b58122 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1715 microversion: 2.20 time: 0.765487 Aug 29 22:47:45.301108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 458/924] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:44 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1715 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:51.863097 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-81cb8f6d-ba20-47f9-9374-c072fea33ca6 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Action: 'create', calling method: .version_select at 0x7f5cf6c2c160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2020196249", "metadata": {"Type": "work"}}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:52.488983 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-81cb8f6d-ba20-47f9-9374-c072fea33ca6 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.159093 Aug 29 22:47:52.498317 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 467/925] 10.222.0.77 () {60 vars in 1156 bytes} [Mon Aug 29 22:47:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1163 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 22:47:52.506460 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f178353c-405f-48c7-92e5-8b6e8fa7fa2e tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6cb68b0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:52.646044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f178353c-405f-48c7-92e5-8b6e8fa7fa2e tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 200 len: 353 microversion: 2.1 time: 0.144861 Aug 29 22:47:52.650585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 459/926] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:52 2022] GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:53.669407 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c0cb4930-ebea-4b46-9046-3feec0287553 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6b92c10>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:53.738175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c0cb4930-ebea-4b46-9046-3feec0287553 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 200 len: 354 microversion: 2.1 time: 0.076830 Aug 29 22:47:53.752475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 468/927] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:53 2022] GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:53.763613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-08cbab4f-68c7-4419-8118-e73ed72c31a6 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6becaf0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:53.863581 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-08cbab4f-68c7-4419-8118-e73ed72c31a6 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 200 len: 354 microversion: 2.1 time: 0.108084 Aug 29 22:47:53.864605 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 460/928] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:53 2022] GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:53.890907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d4fb9200-2fbf-4779-9553-ae4433880383 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6bb6280>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:53.999341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d4fb9200-2fbf-4779-9553-ae4433880383 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 202 len: 0 microversion: 2.1 time: 0.113346 Aug 29 22:47:54.001105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 469/929] 10.222.0.77 () {58 vars in 1248 bytes} [Mon Aug 29 22:47:53 2022] DELETE /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:54.015385 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-574a4489-99cf-45d8-9c64-9ba15f72cc58 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6bd4040>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:54.091968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-574a4489-99cf-45d8-9c64-9ba15f72cc58 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 200 len: 353 microversion: 2.1 time: 0.085343 Aug 29 22:47:54.093975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 461/930] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:54 2022] GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:55.107862 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:55.109604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=56 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:55.118140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed3d2c09-6cae-4568-bc7f-32bad0008a90 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Calling method '.version_select at 0x7f5cf6be6550>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:55.460164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-ed3d2c09-6cae-4568-bc7f-32bad0008a90 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] HTTP exception thrown: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed3d2c09-6cae-4568-bc7f-32bad0008a90 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Request method failure captured: Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 HTTP/1.1 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUIXoftUBYq-dWqau3P9yV13rrX_hr0OZViyV4Tu9FZA8z3bJxvm8kJ626J_sS8s5DHJMi7JFeNst_tlIupna5IEGub3FINYWKE1pXkvQ0ySWSa_AcYmTQvA2XLiJVVH7ESSvrB3voE7hKWm1_psGI64IspKpFBEJ1vDnO2quarIg68 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 346ed3941744457aa077b7b9fe51bf54 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesGetTestJSON-916651321 Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:47:55.464125 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/346ed3941744457aa077b7b9fe51bf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_346ed3941744457aa077b7b9fe51bf54", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/346ed3941744457aa077b7b9fe51bf54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/346ed3941744457aa077b7b9fe51bf54"}]}] Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesGetTestJSON-916651321 Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 346ed3941744457aa077b7b9fe51bf54 Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesGetTestJSON-916651321 Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesGetTestJSON-916651321-project Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 77e911424c1b4e9cb7720370822b46d3 Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesGetTestJSON-916651321-project Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'c23db9ab-dab5-4ed9-94f9-578fe2c9e217'} Aug 29 22:47:55.466948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. (HTTP 404) (Request-ID: req-2fa06365-d649-4b42-8ddf-7eb0756d98e1) Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:55.469758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:47:55.472256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:47:55.477046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ed3d2c09-6cae-4568-bc7f-32bad0008a90 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] Returning 404 to user: Volume c23db9ab-dab5-4ed9-94f9-578fe2c9e217 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ed3d2c09-6cae-4568-bc7f-32bad0008a90 tempest-VolumesGetTestJSON-916651321 tempest-VolumesGetTestJSON-916651321-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217" status: 404 len: 109 microversion: 2.1 time: 0.370556 Aug 29 22:47:55.482103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 470/931] 10.222.0.77 () {58 vars in 1245 bytes} [Mon Aug 29 22:47:55 2022] GET /compute/v2.1/os-volumes/c23db9ab-dab5-4ed9-94f9-578fe2c9e217 => generated 109 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:23.399044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:23.409289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=12 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:23.416866 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:23.420639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:23.429149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.429933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.430319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.431085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.431637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.432061 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.479193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5296cee0-f158-42f7-8022-a91167563a41 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081487 Aug 29 22:48:23.479873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 462/932] 10.222.0.77 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:23 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:23.561514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:23.562289 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:23.568992 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.569577 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.570011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.570717 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.571318 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.571777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.606406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:48:23.719886 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cb7b9332-882f-434d-b88e-43671826b3c9 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 204 len: 0 microversion: 2.20 time: 0.163286 Aug 29 22:48:23.721060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 471/933] 10.222.0.77 () {60 vars in 1280 bytes} [Mon Aug 29 22:48:23 2022] DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:48:23.739045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:23.739045 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:23.740679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.741178 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.741678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.742523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.743112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.743577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.907364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:23.917076 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:23.918532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:23.919766 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-741d2ff2-284f-4b53-9c7c-c8460278f77d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.192814 Aug 29 22:48:23.920320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 463/934] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:23 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:24.949609 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:24.950252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:24.959777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.960511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.961247 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:24.961949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.962509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.962509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:25.147683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:25.159642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:25.161322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:25.162853 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cefa456c-bb1a-4cb9-8db5-4008b908851d tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.218342 Aug 29 22:48:25.163630 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 472/935] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:24 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:26.188316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:26.189158 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:26.197702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.198281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.199029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.200257 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.200728 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.201166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.367322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:26.376517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:26.377961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:26.379169 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2f6deb21-bff7-4fda-b4b8-771ad71ec504 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.195610 Aug 29 22:48:26.379728 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 464/936] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:26 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:27.409205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:27.410433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:27.423413 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.424536 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.425340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.426606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.427639 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.428634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.643152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:27.661634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:27.663525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:27.665258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7611a451-ead0-4845-b0fc-abf588ae4914 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1721 microversion: 2.20 time: 0.265264 Aug 29 22:48:27.679685 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 473/937] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:27 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:28.546014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73099323-acd0-470f-a0e8-5fe1c43ffa61", "name": "network-vif-deleted", "tag": "b903e211-1037-4142-a6a4-fe89c4385560"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:28.565777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.567108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.567894 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.596840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] Creating event network-vif-deleted:b903e211-1037-4142-a6a4-fe89c4385560 for instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 on hv-cinder-85427 Aug 29 22:48:28.616875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-81813eb7-d37e-42b5-9ed2-f800bf073e32 req-8b63f9f6-1244-4dac-b465-f26523e63e09 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078695 Aug 29 22:48:28.618920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 465/938] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:28.690377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.691038 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:28.700882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.701527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.702244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.703596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.705105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.706517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.783855 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.784951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.785660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.787361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'fault' on Instance uuid 73099323-acd0-470f-a0e8-5fe1c43ffa61 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:48:28.849115 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:28.859629 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:28.861505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:28.863369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4a3e1a3e-a4ee-4b7d-ae4a-c9ef484207ae tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1370 microversion: 2.20 time: 0.177440 Aug 29 22:48:28.865136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 474/939] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:29.895665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:29.900006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:29.906648 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:29.907166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:29.907797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.908714 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:29.909169 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:29.910019 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.950515 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:29.951087 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:29.952206 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.952647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'fault' on Instance uuid 73099323-acd0-470f-a0e8-5fe1c43ffa61 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:48:30.003996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:30.019436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:30.022180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:30.023860 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9ca2931c-b29a-4813-a2f1-f3e86fe78dc7 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1370 microversion: 2.20 time: 0.138906 Aug 29 22:48:30.024848 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 466/940] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:29 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:31.055674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:31.056851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:31.064661 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.065229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.065672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.066390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.066881 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.067311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.105103 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.105599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.106045 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.106507 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lazy-loading 'fault' on Instance uuid 73099323-acd0-470f-a0e8-5fe1c43ffa61 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:48:31.153546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:31.164607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:31.166253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003dd6612cda48618966db8c0788b794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e6d1afb63446af887a1de133b7bf2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:31.167970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e324a787-0662-46ae-9caf-0897e9aa4187 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 200 len: 1370 microversion: 2.20 time: 0.119181 Aug 29 22:48:31.168634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 475/941] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:31 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 1370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:32.192078 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.192646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:32.199409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.199929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.200368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.201070 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.201561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.201992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.215749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 HTTP/1.1 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:48:32.217436 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:32.219459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '73099323-acd0-470f-a0e8-5fe1c43ffa61'} Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:32.220335 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:32.221844 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:32.223774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:32.223774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-50b8922e-656c-4e3c-b48e-e653db7b01e2 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 404 len: 111 microversion: 2.20 time: 0.031190 Aug 29 22:48:32.223774 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 467/942] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:32 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:32.231939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f9e05fbf-335f-4a1d-898e-c504455cf632 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '.version_select at 0x7f5cf6b148b0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.258079 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f9e05fbf-335f-4a1d-898e-c504455cf632 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886995151" status: 204 len: 0 microversion: 2.20 time: 0.033268 Aug 29 22:48:32.258655 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 476/943] 10.222.0.77 () {60 vars in 1259 bytes} [Mon Aug 29 22:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886995151 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:48:36.512760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:36.512760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:36.522151 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.522993 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.523742 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.524929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.525621 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.526343 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.551872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 HTTP/1.1 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:48:36.553731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.556523 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '73099323-acd0-470f-a0e8-5fe1c43ffa61'} Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:36.558131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.560556 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.563493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:36.563493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9e8b8d76-0670-473b-b9cd-1863d3eb2c01 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 404 len: 111 microversion: 2.20 time: 0.048021 Aug 29 22:48:36.563493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 468/944] 10.222.0.77 () {60 vars in 1280 bytes} [Mon Aug 29 22:48:36 2022] DELETE /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:36.570164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:36.570902 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 73099323-acd0-470f-a0e8-5fe1c43ffa61] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:36.578176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.578982 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.579504 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.580148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.580612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.581105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.604864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 HTTP/1.1 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:48:36.607920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.610135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '73099323-acd0-470f-a0e8-5fe1c43ffa61'} Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:36.611801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. Aug 29 22:48:36.614275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:36.616612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 73099323-acd0-470f-a0e8-5fe1c43ffa61 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:36.616612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0a8b9c29-1e28-4f86-81f7-9133ef316e61 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61" status: 404 len: 111 microversion: 2.20 time: 0.044860 Aug 29 22:48:36.616612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 477/945] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:36 2022] GET /compute/v2.1/servers/73099323-acd0-470f-a0e8-5fe1c43ffa61 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:37.889796 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:37.891839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:37.908854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.909885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.910592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.911752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.912739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.913928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.939786 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e HTTP/1.1 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:48:37.941943 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:37.943463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '85dd30e7-c635-4bcd-98e3-8aa61c52d30e'} Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:37.944281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:37.946366 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:48:37.950282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:37.952784 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f33f2105-024c-4493-a03c-cd657716a500 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 404 len: 111 microversion: 2.20 time: 0.075437 Aug 29 22:48:37.953641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 469/946] 10.222.0.77 () {60 vars in 1280 bytes} [Mon Aug 29 22:48:37 2022] DELETE /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:48:37.964550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:37.965468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] [instance: 85dd30e7-c635-4bcd-98e3-8aa61c52d30e] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:37.974674 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.975379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.975878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.976659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.977867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.978261 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.002456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] HTTP exception thrown: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Request method failure captured: Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e HTTP/1.1 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUCB1glFmDetXVjCJLYZAXciq0p0SdoLSmerZOW0TkhATzUW1Y1d7lRY-GGj1Ztw8EglGYqe769EI18RGQ8d4W8MIIErxonICwbWVbZRQzDkEIoD1cCxcBbLkOLMHot6qi4T1rNYiscI64E3Tq5eNVTEzSmh1T3d9WouWKMLef4jO4o Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:48:38.005380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05e6d1afb63446af887a1de133b7bf2e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05e6d1afb63446af887a1de133b7bf2e"}]}] Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 05e6d1afb63446af887a1de133b7bf2e Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450082510 Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 003dd6612cda48618966db8c0788b794 Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450082510-project Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:38.008010 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '85dd30e7-c635-4bcd-98e3-8aa61c52d30e'} Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:38.009064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. Aug 29 22:48:38.010968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.013491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] Returning 404 to user: Instance 85dd30e7-c635-4bcd-98e3-8aa61c52d30e could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:38.013491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-981a47a4-b503-42ae-84e7-6b452fbcb001 tempest-AttachVolumeShelveTestJSON-1450082510 tempest-AttachVolumeShelveTestJSON-1450082510-project] 10.222.0.77 "GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e" status: 404 len: 111 microversion: 2.20 time: 0.048489 Aug 29 22:48:38.018508 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 478/947] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:37 2022] GET /compute/v2.1/servers/85dd30e7-c635-4bcd-98e3-8aa61c52d30e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:48:50.416531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1440665939", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "networks": [{"uuid": "da172aa1-4f64-4bb9-9655-6592e47746b6"}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:50.447374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=18 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:50.448147 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=34 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:50.541167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] validate_networks() for [('da172aa1-4f64-4bb9-9655-6592e47746b6', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:52.024924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:52.026011 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:52.028676 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:52.030229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:52.031131 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:52.067991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.071776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.072664 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.075414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.078104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.079300 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.153433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Getting quotas for project b1f240a0b08841edb5906875c5dcf3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:52.159350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Getting quotas for user 17a5395280b342de9a39f2a984a2c0ba and project b1f240a0b08841edb5906875c5dcf3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:52.177764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:52.180557 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:52.247336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3db70860-91b2-44b6-be2d-6bc0e2fb7bea tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.837276 Aug 29 22:48:52.251062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 470/948] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:48:52.271261 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f86e1083-f244-4eaa-8abc-6d97b319a1b3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.275335 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f86e1083-f244-4eaa-8abc-6d97b319a1b3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.288486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:52.291721 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:52.570675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f86e1083-f244-4eaa-8abc-6d97b319a1b3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.587381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f86e1083-f244-4eaa-8abc-6d97b319a1b3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1214 microversion: 2.1 time: 0.325434 Aug 29 22:48:52.588300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 479/949] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.616573 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.617277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.630199 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.631040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.631674 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.634582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.635347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.635949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.869880 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.889654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a1198167-054b-498e-96f4-3dc244c3de65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1218 microversion: 2.1 time: 0.276547 Aug 29 22:48:53.890514 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 471/950] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:54.922027 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.922868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.930516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.930842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.936688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.937979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.938845 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.939452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.100168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.114719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-260b3145-8936-449f-9d72-0e5cda86a724 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1218 microversion: 2.1 time: 0.198452 Aug 29 22:48:55.117473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 480/951] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:56.140239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.140239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.152825 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.154858 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.155330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.157575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.158603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.159084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.274860 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.283212 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-39f03bc0-e57c-4a89-b3ec-bc761b3a0c13 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1272 microversion: 2.1 time: 0.149388 Aug 29 22:48:56.284532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 472/952] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:57.310568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.310568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.338987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.339506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.351848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.352752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.353243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.353697 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.029863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.058118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2ca95bd7-15f3-45b9-8aa4-c9f2f642ad8d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.754110 Aug 29 22:48:58.062895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 481/953] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:59.096478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.098830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.128243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.133632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.139142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.140162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.145392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.146368 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.396359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.410233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-30610e66-104e-4c5f-92a2-aa2474b26d86 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.319108 Aug 29 22:48:59.411345 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 473/954] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:00.016313 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97de149e-8421-4146-9412-4310fd744d3a", "tag": "19f9eb52-b6af-4a64-a37e-c1180d0381bb"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:00.031818 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.032842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.033567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.056669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] Creating event network-changed:19f9eb52-b6af-4a64-a37e-c1180d0381bb for instance 97de149e-8421-4146-9412-4310fd744d3a on hv-cinder-85427 Aug 29 22:49:00.075149 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-e3730ff4-b7de-49db-996d-9ab49526cdf4 req-e8c3cfde-7783-4839-8fc2-c2faaf357c2b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056569 Aug 29 22:49:00.077763 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 482/955] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:00.502904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.511225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.551890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.552584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.553182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.554859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.555540 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.556201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.735403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.754413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a6fe7167-b714-4da4-b538-a63be42cc2fe tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.324004 Aug 29 22:49:00.755284 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 474/956] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.777139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.777999 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.796448 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.797193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.798011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.799380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.800306 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.801119 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.115621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.133358 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dee0b525-9189-4a8b-aea6-5b2a32d0edc6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.360674 Aug 29 22:49:02.158262 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 483/957] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.175353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.176729 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.179393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:03.180641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=6 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:03.200010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.203699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.207180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.208142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.208862 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.214815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.518167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.531067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-66e6a3cf-6c8f-413b-89e0-05dbef3ada65 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.359428 Aug 29 22:49:03.532102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 475/958] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:04.565237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:04.571288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.572070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.583617 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.584110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.584546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.585254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.585709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.586220 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.159526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.205813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fb3d0d22-13ce-4229-863c-054a1a9953ac tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.627121 Aug 29 22:49:05.209429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 484/959] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:06.235141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.236063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.252559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.253063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.258152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.260667 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.261306 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.262083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.699014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.719112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5d8a8122-0f5f-43ed-8e63-9c84504d483e tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.487689 Aug 29 22:49:06.720553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 476/960] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:07.764433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.765437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.788949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.796910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.797894 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.800206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.801206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.802027 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.289433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.307761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f35da490-db2b-4366-b4ac-814477f653d2 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.547462 Aug 29 22:49:08.312286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 485/961] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.337227 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.338310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.351947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.354245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.357976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.361032 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.362996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.363712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.526154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-12fd4cc0-908b-441b-a9e4-766731f081fb tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Action: 'create', calling method: .version_select at 0x7f5cf6c32670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-672647324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyBOjbF6NWjF3J8MiMhnXycGeBIz8UGpKgwgnQ6VeHALWSU5AZn/PmicMoJcvkBVNtpdb3fwIVOwIcs1Z0pc0Gtxzzsm9SrJdGf5UZLRtq626fP4Efp07slJnNSdqyjog=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:09.563500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-12fd4cc0-908b-441b-a9e4-766731f081fb tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for project 36e090f60dd244cea327de965ad9af13. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:09.584769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-12fd4cc0-908b-441b-a9e4-766731f081fb tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for user 1addff9d7c7348de827c4eba89d41660 and project 36e090f60dd244cea327de965ad9af13. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:09.658991 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-12fd4cc0-908b-441b-a9e4-766731f081fb tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.525150 Aug 29 22:49:09.660197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 477/962] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:49:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:09.673332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de149e-8421-4146-9412-4310fd744d3a", "name": "network-vif-plugged", "status": "completed", "tag": "19f9eb52-b6af-4a64-a37e-c1180d0381bb"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:09.701760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.702227 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.704025 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.729028 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.750565 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-26fe9634-56f7-4007-bb29-7d949ab0180a tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.412161 Aug 29 22:49:09.751278 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 486/963] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.752264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] Creating event network-vif-plugged:19f9eb52-b6af-4a64-a37e-c1180d0381bb for instance 97de149e-8421-4146-9412-4310fd744d3a on hv-cinder-85427 Aug 29 22:49:09.758320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-ce371112-c2d7-4643-8b99-19bd062aac37 req-62366968-24ba-4d57-af85-09fbaa752bdd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096829 Aug 29 22:49:09.759925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 478/964] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:10.773546 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.775634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.808065 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.809252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.810711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.813800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.815143 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.818316 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.297693 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:11.312475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c431519b-091a-419c-b8ed-f45dd125cf42 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.544267 Aug 29 22:49:11.316036 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 487/965] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:12.339281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:12.340681 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:12.363103 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.364171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.365857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.371647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.374590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.375751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.921186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:12.941685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a37d5fda-442e-4570-8dfc-aa6fa0445628 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.607407 Aug 29 22:49:12.943676 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 479/966] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:12 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:13.964704 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:13.965429 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.977385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.978194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.978842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.983752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.984530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.985169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.484479 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:14.507110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-405dde64-9855-4b52-bfe9-dd93ee3c25b9 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1314 microversion: 2.1 time: 0.546037 Aug 29 22:49:14.513668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 488/967] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:13 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:15.537895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.539221 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.551442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.556005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.559743 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.562936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.564786 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.565529 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.887055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:15.911352 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b8c68f65-ecd7-4e47-9562-8a017142f1bd tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1497 microversion: 2.1 time: 0.375946 Aug 29 22:49:15.918875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 480/968] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1497 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:16.615003 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.615511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.625561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.626063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.631955 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.638819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.639728 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.640360 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.731237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:49:16.887025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2bdf1f14-17c9-49b3-9188-e7ac901bf302 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "DELETE /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 204 len: 0 microversion: 2.1 time: 0.277856 Aug 29 22:49:16.888485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 489/969] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:49:16 2022] DELETE /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:49:16.902915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.904910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.934256 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.959102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.965445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.971599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.972576 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.973328 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.361360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:17.394298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f8569b41-2aa6-403f-b122-3bfaf9a1d990 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1503 microversion: 2.1 time: 0.500021 Aug 29 22:49:17.395412 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 481/970] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:18.433885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.436376 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:18.450887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.452525 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.454185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.455415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.457589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.458716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.833294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:18.844851 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-86afd51b-1f38-43e7-86f7-d5b06b4a8522 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1503 microversion: 2.1 time: 0.415829 Aug 29 22:49:18.861310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 490/971] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1503 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:19.615551 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de149e-8421-4146-9412-4310fd744d3a", "name": "network-vif-deleted", "tag": "19f9eb52-b6af-4a64-a37e-c1180d0381bb"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:19.629123 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:19.640580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.641563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.643406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.680974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] Creating event network-vif-deleted:19f9eb52-b6af-4a64-a37e-c1180d0381bb for instance 97de149e-8421-4146-9412-4310fd744d3a on hv-cinder-85427 Aug 29 22:49:19.697631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-33ef53cb-0430-41f8-a9ae-1154b4456fe9 req-9299ea1e-87c6-41ec-97b0-622c16b0f6ea service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097079 Aug 29 22:49:19.699651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 482/972] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:19.890482 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:19.891229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:19.903895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.912973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.913662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.914791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.915434 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.916064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.991284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.992465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.993648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.994400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lazy-loading 'fault' on Instance uuid 97de149e-8421-4146-9412-4310fd744d3a {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:20.051444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:20.059829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9446c8ba-fbd6-4787-adbd-4d9a38a362aa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 200 len: 1304 microversion: 2.1 time: 0.176763 Aug 29 22:49:20.060426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 491/973] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:19 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:21.095369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.097552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: 97de149e-8421-4146-9412-4310fd744d3a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.100961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:21.111841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.113503 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.131437 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.132832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.133673 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.134132 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.139221 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=61 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:21.158091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] HTTP exception thrown: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Request method failure captured: Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a HTTP/1.1 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUJQcsJNFJkxwdyYJ6ItOhu_vT87pNvaUl7J_38TK9r5R2vcFenkBfM6IYTUEWjaw-3fVflJD94nNCdPNRNE2CDxQB8Kn4drKYJG5rV_RVeaXJ2lWvZAKiNh1aSSAlQl8yZf6SRsVbP-z0s0LroqGBEt5rulLmeBTR_Ho5H_B3OYyuA Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: b1f240a0b08841edb5906875c5dcf3e7 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-VolumesActionsTest-343069233 Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:49:21.172778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/b1f240a0b08841edb5906875c5dcf3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_b1f240a0b08841edb5906875c5dcf3e7", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b1f240a0b08841edb5906875c5dcf3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b1f240a0b08841edb5906875c5dcf3e7"}]}] Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-VolumesActionsTest-343069233 Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: b1f240a0b08841edb5906875c5dcf3e7 Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-VolumesActionsTest-343069233 Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-VolumesActionsTest-343069233-project Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 17a5395280b342de9a39f2a984a2c0ba Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-VolumesActionsTest-343069233-project Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. Aug 29 22:49:21.174197 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '97de149e-8421-4146-9412-4310fd744d3a'} Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:21.175156 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. Aug 29 22:49:21.181871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:49:21.184995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Returning 404 to user: Instance 97de149e-8421-4146-9412-4310fd744d3a could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:21.184995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0c5e0bed-87d9-432f-9dda-b4c7e396f762 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a" status: 404 len: 111 microversion: 2.1 time: 0.088908 Aug 29 22:49:21.184995 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 483/974] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:21 2022] GET /compute/v2.1/servers/97de149e-8421-4146-9412-4310fd744d3a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:49:21.411263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2006205889", "imageRef": "bd7f3474-4120-4f14-a9ad-31c962fd41ba", "flavorRef": "452", "networks": [{"uuid": "da172aa1-4f64-4bb9-9655-6592e47746b6"}]}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:22.813814 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] validate_networks() for [('da172aa1-4f64-4bb9-9655-6592e47746b6', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:49:23.610313 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:49:23.610761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:49:23.611435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:49:23.612518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:49:23.613132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:49:23.615704 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:23.627752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.631625 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.632904 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.633925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.634806 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.635502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.650208 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:23.667060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Getting quotas for project b1f240a0b08841edb5906875c5dcf3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:23.669587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Getting quotas for user 17a5395280b342de9a39f2a984a2c0ba and project b1f240a0b08841edb5906875c5dcf3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:23.686216 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:49:23.688596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd7f3474-4120-4f14-a9ad-31c962fd41ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:49:23.752258 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [1fc0428f-d753-41f0-97a1-0b1726857e96] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 22:49:24.773337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO oslo.messaging._drivers.impl_rabbit [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [1fc0428f-d753-41f0-97a1-0b1726857e96] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 42684. Aug 29 22:49:24.777898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d81e1d4b-94a4-4745-a950-39c5ba0b7603 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.376832 Aug 29 22:49:24.778825 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 492/975] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:49:24.801293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-97c51b19-9876-4b2a-8cac-e738a1050531 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.803425 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-97c51b19-9876-4b2a-8cac-e738a1050531 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.921845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-97c51b19-9876-4b2a-8cac-e738a1050531 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:24.938612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-97c51b19-9876-4b2a-8cac-e738a1050531 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1214 microversion: 2.1 time: 0.147408 Aug 29 22:49:24.951207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 484/976] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:25.709366 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6ce97200-5f68-455b-888f-7b844b82ecec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'create', calling method: .version_select at 0x7f5cf6b95af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1630077036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7KNngP3zIIVMQp4mZj6oorh22wAYkPmuLbawzUmh9+jXwLjV7JRmOQaIXZAdz4XFdz6LuEsUCbiRZJMy9yN1du1I2tVM1lG7Sevo5+Uk3DdBlxqswoi9F6Q7Lx8L/CFg=="}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:25.727110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-6ce97200-5f68-455b-888f-7b844b82ecec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Getting quotas for project c814b0ae26d84c08b9c27e1f11d3b2ff. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:25.731162 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-6ce97200-5f68-455b-888f-7b844b82ecec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Getting quotas for user 9f7d298884b743f49760437628fc65aa and project c814b0ae26d84c08b9c27e1f11d3b2ff. Resources: {'key_pairs'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:25.757057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6ce97200-5f68-455b-888f-7b844b82ecec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053162 Aug 29 22:49:25.757802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 493/977] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:49:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:25.918244 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-505384013", "imageRef": "4174479c-e32e-4fe8-9ec7-945724804793", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1630077036", "networks": [{"uuid": "289d5317-906f-489d-ad26-1f02ec75ed7d"}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:25.975150 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:25.975888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:25.985939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.986857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.987996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.988961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] validate_networks() for [('289d5317-906f-489d-ad26-1f02ec75ed7d', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:49:25.989819 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.990292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.990721 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.094282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:26.108866 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2c6e2eae-5f29-4827-9f07-efa4638e0501 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1266 microversion: 2.1 time: 0.143872 Aug 29 22:49:26.109462 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 494/978] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:25 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:26.579558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:49:26.580476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:49:26.581453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:49:26.582308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:49:26.583189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:49:26.603776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.604608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.605486 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.607226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.608428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.609192 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.644239 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Getting quotas for project c814b0ae26d84c08b9c27e1f11d3b2ff. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:26.651345 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Getting quotas for user 9f7d298884b743f49760437628fc65aa and project c814b0ae26d84c08b9c27e1f11d3b2ff. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:26.674192 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:49:26.678959 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4174479c-e32e-4fe8-9ec7-945724804793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:49:26.742583 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-417ef2e3-cc01-49f2-b948-c29ac809bd13 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828186 Aug 29 22:49:26.743268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 485/979] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:49:26.761533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f421cbf0-3ebd-4d87-a3d6-493ad0b6dfad tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.762899 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f421cbf0-3ebd-4d87-a3d6-493ad0b6dfad tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.847868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-f421cbf0-3ebd-4d87-a3d6-493ad0b6dfad tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:26.857940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f421cbf0-3ebd-4d87-a3d6-493ad0b6dfad tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1258 microversion: 2.1 time: 0.101361 Aug 29 22:49:26.858517 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 495/980] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:27.135399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.136752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.147006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.148904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.149809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.150973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.152128 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.153444 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.257070 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:27.280829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-290bb71a-ad4d-495f-a49b-54f78b8333eb tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1272 microversion: 2.1 time: 0.152053 Aug 29 22:49:27.293607 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 486/981] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:27.889398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.890229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.898048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.898537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.899016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.899735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.900193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.900648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.981744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:27.991841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-e631a4e4-95b1-4280-a769-db98e70ca2ae tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1310 microversion: 2.1 time: 0.106668 Aug 29 22:49:27.992576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 496/982] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:28.227246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12cc83a-69f0-4953-83a4-77d04972148a", "tag": "4b5e7b71-0789-4c6a-9c3f-66ccacdbb089"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:28.277562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.280141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.283339 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.305324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] Creating event network-changed:4b5e7b71-0789-4c6a-9c3f-66ccacdbb089 for instance e12cc83a-69f0-4953-83a4-77d04972148a on hv-cinder-85427 Aug 29 22:49:28.319071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.320562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.324093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-a29cb917-ab0b-4014-b914-a7fe0732e891 req-ae9378f3-bde5-4623-8dac-c5a895632713 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105576 Aug 29 22:49:28.325893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 487/983] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:28.330276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.331281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.332023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.333591 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.334432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.335219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.804803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:28.846418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-70c0f985-9b3a-45c8-b3ec-0fe02fa86fc7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.533749 Aug 29 22:49:28.859471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 497/984] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:29.021731 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.022551 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.049584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.050397 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.051687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.052740 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.055269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.055974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.154114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1818826863", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-672647324", "security_groups": [{"name": "tempest-secgroup-smoke-1584453056"}], "block_device_mapping_v2": [{"uuid": "2b2b8d96-e3c8-4bd8-95fd-6f06dacd34ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97336a57-5879-42cd-b56c-34e6fb04c8c0"}]}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:29.275539 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:29.296786 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7f96b329-055e-4413-b101-ae998e3f0433 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1316 microversion: 2.1 time: 0.279372 Aug 29 22:49:29.297975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 488/985] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:29.550542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] validate_networks() for [('97336a57-5879-42cd-b56c-34e6fb04c8c0', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:49:29.898941 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.899699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.916276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.928187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.932302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.934608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.939493 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.941700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.533790 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:30.549873 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ac72a255-4b8b-4436-9df3-f8c056e80774 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.666524 Aug 29 22:49:30.551427 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 489/986] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:30.568875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.570160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:30.584906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.592601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.595829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.599736 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.601719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.603502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.628404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:49:30.629516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:49:30.630634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:49:30.631604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:49:30.632543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:49:30.653537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.654781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.655896 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.657794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.659980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.671447 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.716406 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:30.723919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for user 1addff9d7c7348de827c4eba89d41660 and project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:30.850788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:49:30.861161 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b2b8d96-e3c8-4bd8-95fd-6f06dacd34ba',volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:49:30.933360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:30.945785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e12691de-df7a-454a-b6b6-464824a197f0 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.392789 Aug 29 22:49:30.962029 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 490/987] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:31.108165 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-97e6c42c-3e95-4e79-b687-99cf25a41e9b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.958620 Aug 29 22:49:31.128614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6d76d560-d059-44e8-b6d3-4cbd86f6f419 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.129613 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 498/988] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:49:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:49:31.130409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6d76d560-d059-44e8-b6d3-4cbd86f6f419 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.237765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6d76d560-d059-44e8-b6d3-4cbd86f6f419 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:31.247957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6d76d560-d059-44e8-b6d3-4cbd86f6f419 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1094 microversion: 2.1 time: 0.126621 Aug 29 22:49:31.262769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 491/989] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:31.581590 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.582498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.598584 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.611746 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.612404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.613687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.614378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.615035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.937071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:31.982593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.986086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.987080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d87a9064-caa9-4b0a-a5f0-a563bc33faa7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.407413 Aug 29 22:49:31.990915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 499/990] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:32.013166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.014407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.015525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.017032 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.018109 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.019166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.252872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:32.264855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6b7bdfd9-b5e2-4e5d-b665-346d1fbf7b62 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.297658 Aug 29 22:49:32.265965 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 492/991] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:32.301451 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.302574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.314521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.315820 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.316684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.319072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.319436 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.320405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.420256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:32.436779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a45cdb04-2720-4e6e-9555-9396939937a9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.143081 Aug 29 22:49:32.444174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 500/992] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:33.023315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.025778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.041661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.042882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.043946 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.046273 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.047414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.048146 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.307359 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.308516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.332058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.332796 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.333389 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.334241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.334911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.342619 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.383717 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.397666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-515b0a80-ed57-444d-9a9b-26bc0df56c67 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.388047 Aug 29 22:49:33.402545 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 493/993] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:33.467715 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.470856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.486837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.487701 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.488893 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.492758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.495498 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.496332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.622034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.637512 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2889cfec-531b-4b1a-9ad6-9b7234addcd3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.339815 Aug 29 22:49:33.663452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 501/994] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:33.695024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.707899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-66326b44-8459-4c51-be39-73c3545a6f67 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.251808 Aug 29 22:49:33.718765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 494/995] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:34.436916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.438239 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.450491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.451551 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.452405 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.453868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.454638 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.455494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.653771 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:34.667807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-94ddf9ed-7840-459c-bf36-366d1c5ca1f3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.238090 Aug 29 22:49:34.670402 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 502/996] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:34.670608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.670608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.691930 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.701802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.702685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.704258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.705094 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.705936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.760836 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.762673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.776840 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.777462 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.778477 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.779268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.779734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.780268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.920574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:34.929221 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9873ff2c-1a01-4183-948d-21757246f607 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.174035 Aug 29 22:49:34.930118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 503/997] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:35.015918 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:35.029970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-44f70a12-4404-4525-a4a5-3faa67b0c0c3 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.364320 Aug 29 22:49:35.031041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 495/998] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:35.385917 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12cc83a-69f0-4953-83a4-77d04972148a", "name": "network-vif-plugged", "status": "completed", "tag": "4b5e7b71-0789-4c6a-9c3f-66ccacdbb089"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:35.410276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.410276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.410276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.434047 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] Creating event network-vif-plugged:4b5e7b71-0789-4c6a-9c3f-66ccacdbb089 for instance e12cc83a-69f0-4953-83a4-77d04972148a on hv-cinder-85427 Aug 29 22:49:35.451946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-2058829e-5356-4d68-9f0e-5294a027d14e req-c06e2b7d-45d1-45a7-b908-1d2493ecd937 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069345 Aug 29 22:49:35.453468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 504/999] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:35.705590 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.707704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.713663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.714155 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.714593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.715450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.715909 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.716337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.911110 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:35.931694 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-83e0be64-66fa-470c-9e94-2498b804e440 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.233863 Aug 29 22:49:35.932500 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 496/1000] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:35.963981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.964719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.972237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.972956 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.973553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.974480 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.975222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.975912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.060874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.063004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.064812 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:36.072533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.073377 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.074579 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.075702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-79af55a9-5ae4-43d9-bec4-c5a4ed8f18e5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.117069 Aug 29 22:49:36.075983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.076286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 505/1001] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:36.076794 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.077492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.266157 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:36.277086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-36948c21-f098-440f-825d-54519e51d5ec tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.223812 Aug 29 22:49:36.278453 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 497/1002] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:36.954800 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.955493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.963048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.963542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.963991 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.964692 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.965683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.966123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.108332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.109051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.111095 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:37.131322 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.132207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.132987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.134304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.135434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.136195 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.156514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.169457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-008a2a2c-bc24-405b-b9ff-1e09ebe8b4fa tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.218495 Aug 29 22:49:37.172932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 506/1003] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:37.247829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.258585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4111f2f4-a9e1-4260-950b-7878e3fd6a98 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.154769 Aug 29 22:49:37.259409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 498/1004] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:37.300459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.301192 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.308724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.309777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.310206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.310948 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.311403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.311823 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.478465 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.489670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ad1e25b0-d722-4623-ab13-a84512b659b4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.193458 Aug 29 22:49:37.491030 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 507/1005] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.195652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.196462 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.204233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.205101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.205577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.206348 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.206837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.207449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.285675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.286836 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.298910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.300064 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.301141 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.302565 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.303387 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.304205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.413530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.423217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8e5f1d51-932a-45ce-a4f3-f407974f3377 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1144 microversion: 2.1 time: 0.143876 Aug 29 22:49:38.423867 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 508/1006] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1144 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.431181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.440059 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e50d1dd9-8b64-4817-ad8a-a69fc07a4a3c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.249063 Aug 29 22:49:38.440828 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 499/1007] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.511244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.511911 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.518359 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.518973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.519323 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.520015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.520527 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.520958 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.669005 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.677133 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-90c1acdc-a762-4237-8153-9aec5356c926 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.169715 Aug 29 22:49:38.677700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 509/1008] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:39.447247 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.447870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.455789 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.456447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.456892 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.462578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.465222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.470677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.471496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.472104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.487105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.487913 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.488537 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.489443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.492088 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.492724 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.653962 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.663686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6e1e8beb-fe7b-4bb7-a87d-1eae072958a4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1192 microversion: 2.1 time: 0.220501 Aug 29 22:49:39.664353 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 500/1009] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1192 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:39.700602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.701235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.709854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.710461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.711461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.712465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.713062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.714001 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.878266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.889094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-30590610-a864-4e47-aa6c-e119ba4d1e40 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.429819 Aug 29 22:49:39.904253 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 510/1010] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:39.955457 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.964241 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-12d4c63f-6ac8-4adc-891b-0366cd8bd720 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.268985 Aug 29 22:49:39.965268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 501/1011] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:40.059747 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:40.070518 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.071356 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.072128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.094390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] Creating event network-changed:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:49:40.101748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-9ed0ad28-f2fe-4e70-a39f-6bb2f92007e6 req-b3d5ce0b-a366-4491-a37f-c91ad6f6f801 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046485 Aug 29 22:49:40.102364 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 511/1012] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:40.687815 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.688695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.695475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.696258 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.696838 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.698077 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.698936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.699665 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.769281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:40.778304 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9508f605-2369-4fdf-b3da-fc260afc94a3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1210 microversion: 2.1 time: 0.093616 Aug 29 22:49:40.778836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 502/1013] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:40.922229 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.928232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.949983 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.955290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=18 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.961497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.962014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.962520 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.964213 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.964213 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.965276 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.995660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.997801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.023633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.024311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.025154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.026232 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.026923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.036217 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.248277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=10 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.470581 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.481140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-9e731794-2791-4846-9946-ddbb1108e030 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1314 microversion: 2.1 time: 0.564193 Aug 29 22:49:41.483689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 512/1014] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:41.537333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.540024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.548055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4193b29b-8301-42b1-ac29-68629274dfd9 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.559438 Aug 29 22:49:41.552798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 503/1015] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:41.804857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.806928 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.814964 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.816226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.816937 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.818042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.818658 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.819280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.849349 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=100 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.936037 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.949615 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-5ad7ba20-85f5-42c2-9e7f-40129d3b88f0 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1198 microversion: 2.1 time: 0.151501 Aug 29 22:49:41.951196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 513/1016] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1198 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.506758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.507266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.513386 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.513876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.514316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.515054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.515519 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.515946 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.580532 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.580949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.588236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.588891 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.589445 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.590377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.591023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.591612 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.755632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:42.770937 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5cb540ea-b775-4608-827e-b6c651d44ce7 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1498 microversion: 2.1 time: 0.268759 Aug 29 22:49:42.789918 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 504/1017] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.857119 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:42.867284 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0bbead04-8020-422f-95b4-2ea4b54dc03b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.295819 Aug 29 22:49:42.868392 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 514/1018] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.974419 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.975316 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.991180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.992036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.992700 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.995843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.997324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.997982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.377718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.378324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.384714 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.384933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.385569 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.386273 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.386786 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.387425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.389264 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:43.397823 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-50536fd8-cad6-4c12-8d45-657c5a4a374d tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.427383 Aug 29 22:49:43.400642 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 505/1019] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:43.438529 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:49:43.608310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-f3bceffa-449f-48f6-b819-af8cd5fcbdde tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 204 len: 0 microversion: 2.1 time: 0.232908 Aug 29 22:49:43.609923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 515/1020] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:49:43 2022] DELETE /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:49:43.624492 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.627291 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.640670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.641724 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.642358 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.643277 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.644201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.644855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.853555 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:43.865832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f5d30d31-2752-48fe-9872-7309005a705c tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1504 microversion: 2.1 time: 0.249378 Aug 29 22:49:43.867403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 506/1021] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:43.893797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.894765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.901676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.902274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.903001 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.903921 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.904601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.905131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.989554 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0919031f-4373-45d3-b94e-29635868fcac", "tag": "0e27f728-d25a-4c36-8bb7-06a74c15089c"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:44.020249 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.021487 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.022310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.055238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] Creating event network-changed:0e27f728-d25a-4c36-8bb7-06a74c15089c for instance 0919031f-4373-45d3-b94e-29635868fcac on hv-cinder-85427 Aug 29 22:49:44.063148 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-ce067676-63e9-4ab2-8bed-9d893bb823be req-a5e025eb-48a3-4ff4-93a2-782ce686f579 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083010 Aug 29 22:49:44.064104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 507/1022] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:44.132063 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:44.144062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-148a0af5-12cf-43ff-89a4-3b1f7c2058a4 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.255128 Aug 29 22:49:44.144588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 516/1023] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:44.422566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.423326 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.429534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.430016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.430461 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.431187 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.431643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.432065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.571404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:44.582035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6d21a2a0-85a1-41eb-8053-57db437ab223 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.163818 Aug 29 22:49:44.582616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 508/1024] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:44.889287 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.889942 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.896700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.897202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.897649 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.898414 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.898922 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.899357 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.082971 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:45.092494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cd017649-47e6-4611-a2b8-c6d4c8ccd8a6 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1504 microversion: 2.1 time: 0.207036 Aug 29 22:49:45.093850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 517/1025] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:45.216234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.219820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.239981 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.240758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.241365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.242319 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.243007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.243751 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.607882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.609365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.620749 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.622591 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.623618 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.625215 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.626678 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.627752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.635870 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:45.645695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0c57f5e5-26b8-447b-912b-e5fa250a996c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.477934 Aug 29 22:49:45.647475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 509/1026] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:45.802532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12cc83a-69f0-4953-83a4-77d04972148a", "name": "network-vif-deleted", "tag": "4b5e7b71-0789-4c6a-9c3f-66ccacdbb089"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:45.817218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.817999 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.818437 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.832705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] Creating event network-vif-deleted:4b5e7b71-0789-4c6a-9c3f-66ccacdbb089 for instance e12cc83a-69f0-4953-83a4-77d04972148a on hv-cinder-85427 Aug 29 22:49:45.840695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-2a033245-1682-4c4c-9d63-674431c48e38 req-b52bf8a8-2126-4c09-9435-603fdf2f3b89 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041314 Aug 29 22:49:45.841637 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 510/1027] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:45.900708 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:45.918640 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-00c3d8d4-50c2-4c31-81d1-8df75a76da08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.318569 Aug 29 22:49:45.919270 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 518/1028] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:46.119668 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.120288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.127375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.127868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.128307 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.129009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.129464 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.129885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.220365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:46.234825 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d048d898-c1d1-4bd4-90b0-fa7b90fbde3b tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1462 microversion: 2.1 time: 0.120971 Aug 29 22:49:46.235505 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 511/1029] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:46.676660 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.677279 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.679370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.685256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.685752 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.686198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.686953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.687415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.687849 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.842533 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:46.850854 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-14792f61-4bf2-469f-b457-eae7968933b1 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.178042 Aug 29 22:49:46.851709 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 519/1030] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:46.939957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.940564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.947359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.947836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.948265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.949560 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.950010 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.950434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.128906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:47.138911 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3e3a1a82-c41f-4dd0-bac8-16ba51e9a599 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.202679 Aug 29 22:49:47.139623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 512/1031] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:47.258330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.259076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.265807 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.266296 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.266768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.267519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.267966 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.268398 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.354686 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:47.364326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-37d32f5c-d230-4d8d-8b6a-d5c612ace66d tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1299 microversion: 2.1 time: 0.110535 Aug 29 22:49:47.364907 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 520/1032] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:47.875832 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.876585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.883149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.883650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.884092 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.884863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.885320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.885749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.043639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:48.053790 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e078938a-c35f-4f1e-852e-2ea1098532e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.182441 Aug 29 22:49:48.054868 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 513/1033] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:48.161473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.162084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.169255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.169737 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.170169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.170898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.171353 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.171775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.331324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:48.348199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-65e9c060-efa9-44f8-929c-dd7823e4fdf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.190192 Aug 29 22:49:48.349232 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 521/1034] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:48.385654 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.386254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.392920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.393407 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.393833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.394537 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.395054 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.395434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.436067 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.436671 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.437107 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.437564 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lazy-loading 'fault' on Instance uuid e12cc83a-69f0-4953-83a4-77d04972148a {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:48.487454 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5395280b342de9a39f2a984a2c0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f240a0b08841edb5906875c5dcf3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:48.497520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-7539cebf-4ba2-410c-b2df-1354835d1067 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 200 len: 1304 microversion: 2.1 time: 0.115521 Aug 29 22:49:48.498270 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 514/1035] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:49.084659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.085888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.098973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.099996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.100871 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.102491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.103817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.104457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.287552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:49.296928 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-a8dfac77-a933-43c8-9726-dabacf680c18 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.220293 Aug 29 22:49:49.297803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 522/1036] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:49.383017 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.384024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.396945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.396945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.396945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.397313 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.397855 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.399041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.523578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.524589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] [instance: e12cc83a-69f0-4953-83a4-77d04972148a] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.534289 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.535199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.535884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.537042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.537781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.538485 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.562202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] HTTP exception thrown: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Request method failure captured: Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a HTTP/1.1 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUJQcsJNFJkxwdyYJ6ItOhu_vT87pNvaUl7J_38TK9r5R2vcFenkBfM6IYTUEWjaw-3fVflJD94nNCdPNRNE2CDxQB8Kn4drKYJG5rV_RVeaXJ2lWvZAKiNh1aSSAlQl8yZf6SRsVbP-z0s0LroqGBEt5rulLmeBTR_Ho5H_B3OYyuA Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: b1f240a0b08841edb5906875c5dcf3e7 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-VolumesActionsTest-343069233 Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:49:49.565255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/b1f240a0b08841edb5906875c5dcf3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_b1f240a0b08841edb5906875c5dcf3e7", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b1f240a0b08841edb5906875c5dcf3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b1f240a0b08841edb5906875c5dcf3e7"}]}] Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-VolumesActionsTest-343069233 Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: b1f240a0b08841edb5906875c5dcf3e7 Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-VolumesActionsTest-343069233 Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-VolumesActionsTest-343069233-project Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 17a5395280b342de9a39f2a984a2c0ba Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-VolumesActionsTest-343069233-project Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. Aug 29 22:49:49.568072 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': 'e12cc83a-69f0-4953-83a4-77d04972148a'} Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:49.570268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. Aug 29 22:49:49.572817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:49:49.576394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] Returning 404 to user: Instance e12cc83a-69f0-4953-83a4-77d04972148a could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:49.576394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-76865685-61b5-45e7-abcb-dfe650c534a3 tempest-VolumesActionsTest-343069233 tempest-VolumesActionsTest-343069233-project] 10.222.0.77 "GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a" status: 404 len: 111 microversion: 2.1 time: 0.049734 Aug 29 22:49:49.576394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 523/1037] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/e12cc83a-69f0-4953-83a4-77d04972148a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:49:49.576819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:49.580984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1b4ee932-0661-49ac-b8a9-e8dafa30609e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.201836 Aug 29 22:49:49.581575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 515/1038] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:50.334343 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.335382 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.345712 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.346202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.346646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.347440 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.348033 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.348553 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.605386 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "name": "network-vif-plugged", "status": "completed", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:50.619927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.622289 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.624062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.627656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:50.645195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d1deac75-517f-4de1-87c6-69cd57f7fb65 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.318350 Aug 29 22:49:50.645753 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 524/1039] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:50.647759 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] Creating event network-vif-plugged:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:49:50.652053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.653006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.653553 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-8d8ea59b-44fb-4903-9f3a-e3e5aaf4d90b req-1ac9572d-9203-4333-9911-1a8354a6c97d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055623 Aug 29 22:49:50.654628 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 516/1040] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:50.659386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.660775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.661684 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.662743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.663401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.663995 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.901057 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:50.911947 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2ba3e58f-d772-4917-8d2a-3ee93956c31c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.264502 Aug 29 22:49:50.912861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 525/1041] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:51.679987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.682713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.686606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:51.697186 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.698837 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.700287 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.702179 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.703201 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.704839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.896293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:51.909125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-72a7c08b-beec-47f9-9bb5-375259ac4eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.238921 Aug 29 22:49:51.910038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 517/1042] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:51.939300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.940166 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.948558 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.949345 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.949954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.950898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.951484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.951919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.100368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:52.112596 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-693ec832-e3e6-4c61-a091-c60ee4530cee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.179208 Aug 29 22:49:52.113271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 526/1043] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:52.932503 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:52.933303 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:52.940739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.941549 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.942265 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.943448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.944008 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.944670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.121418 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:53.132954 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4183e466-1cb1-41c8-81be-47260350d1b8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.204270 Aug 29 22:49:53.134203 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 518/1044] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:52 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:53.142304 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.143498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.154541 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.155255 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.155865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.156735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.157415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.158194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.329805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:53.338379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b9f08054-6364-4982-97c9-7a9490cb4d20 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.203187 Aug 29 22:49:53.338987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 527/1045] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:54.155531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.156426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:54.162756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.163259 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.163678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.164381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.164825 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.165240 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.343806 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:54.352895 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-779a7790-dc68-4094-970a-1cab356c681f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1358 microversion: 2.1 time: 0.201669 Aug 29 22:49:54.353506 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 519/1046] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:54.362008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.362876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:54.369656 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.370148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.370588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.371928 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.372393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.372827 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.546022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:54.561841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8e470c87-2a1f-4063-85fa-8c161c5e4f8c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.203259 Aug 29 22:49:54.562839 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 528/1047] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:55.380777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.382333 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.404780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.405636 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.406713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.408084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.408561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.409065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.587283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.590008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.603442 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.604415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.605796 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.607124 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.611797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.611797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.620240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:55.698478 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:55.706852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-762d2a8b-4a2f-4a55-8f29-8451d2c0b414 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1547 microversion: 2.1 time: 0.331424 Aug 29 22:49:55.725311 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 520/1048] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1547 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:55.734929 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.736574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.746992 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.748283 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.749315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.750758 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.752305 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.753207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.865923 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:55.888600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b573c44d-444b-44cb-b807-339fdee1c9ee tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.306518 Aug 29 22:49:55.889587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 529/1049] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:56.198811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:56.214658 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-32383cc5-e24c-4203-97da-45a92a754e1f tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1547 microversion: 2.1 time: 0.486732 Aug 29 22:49:56.215707 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 521/1050] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1547 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:56.246916 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.254511 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:56.255500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Searching by: {'deleted': False, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff'} {{(pid=148457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 22:49:56.263274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.264041 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.264653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.265582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.266244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.266676 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.375073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.multi_cell_list [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=148457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 22:49:56.551996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-505adfa1-15b2-4620-8fc4-3385db486907 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.311744 Aug 29 22:49:56.553415 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 530/1051] 10.222.0.77 () {58 vars in 1125 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:56.575093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.576811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.592375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.596830 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.597777 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.600577 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.603585 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.604376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.621042 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=100 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.929722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.933565 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.945482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:56.955058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.955976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.956941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.957534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e8de7927-410e-4153-a977-b6a8589cbb0c tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1547 microversion: 2.1 time: 0.391625 Aug 29 22:49:56.958516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.958819 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 522/1052] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1547 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:56.960109 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.960876 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.325025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:57.352016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1e4b41fe-21d4-40af-bc0e-b85cb3b17ced tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.425168 Aug 29 22:49:57.357844 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 531/1053] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:58.379526 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.384841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.390899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.391449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.392004 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.392940 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.394084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.395785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.670449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:58.686271 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-367414b6-4769-4daa-9225-65b80ce45f87 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.311524 Aug 29 22:49:58.696234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 523/1054] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:58.779666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0919031f-4373-45d3-b94e-29635868fcac", "name": "network-vif-plugged", "status": "completed", "tag": "0e27f728-d25a-4c36-8bb7-06a74c15089c"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:58.798355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.799381 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.800022 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.813259 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] Creating event network-vif-plugged:0e27f728-d25a-4c36-8bb7-06a74c15089c for instance 0919031f-4373-45d3-b94e-29635868fcac on hv-cinder-85427 Aug 29 22:49:58.831779 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-8e191261-5f06-479b-b804-2bfb99657cc3 req-4e5a88f3-9c06-43fa-94f8-dcb33ba71cdd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059508 Aug 29 22:49:58.833294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 532/1055] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:59.419691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c396ad1-9342-4111-a011-75ba83685657"}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:59.423534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.431446 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.432447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.432925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.433684 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.434308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.434974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.724791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:59.725932 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.734782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.735266 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.735950 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.736767 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.737351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.737886 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.945624 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b479715d-d812-4e13-9bd7-935ea9ac70dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533687 Aug 29 22:49:59.957663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 524/1056] 10.222.0.77 () {60 vars in 1323 bytes} [Mon Aug 29 22:49:59 2022] POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:59.973172 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:00.015606 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c0a0bb50-1bd9-46cf-9a73-c702a9148994 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1266 microversion: 2.1 time: 0.295635 Aug 29 22:50:00.019361 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 533/1057] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:59 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:01.060979 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.062663 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.072301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.072301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.073084 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.074612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.075235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.075652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.259378 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:01.270413 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0e456cd3-4709-4612-80b7-544c729956e2 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1451 microversion: 2.1 time: 0.215485 Aug 29 22:50:01.289411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 525/1058] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1451 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:01.302386 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.304601 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.315987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.317054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.319648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.320993 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.321552 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.322051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.545099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:01.555890 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2a88ec35-eb70-4e57-a17d-6c1a83de412a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1451 microversion: 2.1 time: 0.263719 Aug 29 22:50:01.559476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 534/1059] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1451 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:04.403953 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0919031f-4373-45d3-b94e-29635868fcac", "tag": "0e27f728-d25a-4c36-8bb7-06a74c15089c"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:04.432440 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.433652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.434133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.473170 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] Creating event network-changed:0e27f728-d25a-4c36-8bb7-06a74c15089c for instance 0919031f-4373-45d3-b94e-29635868fcac on hv-cinder-85427 Aug 29 22:50:04.483725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-5329b044-3ad7-4151-ba7a-363e8d8e8681 req-d3b4f1a0-63fb-4e51-9b6a-641b3f795e84 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085564 Aug 29 22:50:04.485099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 526/1060] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:07.991458 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.992829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.996635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:08.005521 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.005976 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.006491 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.007322 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.007780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.008203 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.199117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:08.208944 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3c4c0576-3ddf-4063-8dba-c48e3fd95b77 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1593 microversion: 2.1 time: 0.221305 Aug 29 22:50:08.209841 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 535/1061] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:11.164218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:11.174666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.175207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.175743 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.194314 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] Creating event network-changed:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:50:11.207593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-2c732cc3-a5a5-428b-9bd3-463a6f012bcc req-20540f1c-9035-4256-9259-a20339a50612 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047451 Aug 29 22:50:11.210095 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 527/1062] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:13.157542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1128230593"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:13.158090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.173099 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.173593 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.174031 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.175175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.175760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.176390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.342385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.network.security_group_api [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Adding security group 14e76dd2-8a30-4849-ad57-7c2430784d8e to port 8cec05bd-1e08-4f8e-a54b-ec0c947a77bf Aug 29 22:50:13.859025 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3dae086a-5e38-45c6-b977-51ae6fad0f1d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action" status: 202 len: 0 microversion: 2.1 time: 0.703490 Aug 29 22:50:13.864325 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 536/1063] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:13 2022] POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:50:13.877725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.879020 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.881910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:13.898136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.899383 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.900326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.901980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.902463 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.903054 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.904092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.906403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.908360 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.934769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] Creating event network-changed:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:50:13.947049 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-03eecdc5-d12b-4657-b979-5f3a5fa9be41 req-81db267c-fcf0-4825-aa6a-72121bb39397 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082106 Aug 29 22:50:13.949301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 528/1064] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:14.817401 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:14.842118 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d4590c9d-366f-46f7-bfe3-db90ca80891a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1759 microversion: 2.1 time: 0.972188 Aug 29 22:50:14.848168 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 537/1065] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1759 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:30.754105 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=23 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:30.754843 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:30.977626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9c6702ae-6125-4bd5-95e6-50c04f118ee5 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Action: 'create', calling method: .version_select at 0x7f5cf6bd4dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1741155288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnJkot81viVRvVjBIWr8yoyT11Kzv+NWSgySGWYHI8Ba8gaWekyZL3JAdSWUJryBVykPfa3c4O/PVOE1ohUV991ppad+bPL9kGBgeRA6q0fgBGouq/HPlu7/5B9ilXgFA=="}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:31.001651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-9c6702ae-6125-4bd5-95e6-50c04f118ee5 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Getting quotas for project 01c16f8389774f4c94889a562cdd38f9. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:50:31.016572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-9c6702ae-6125-4bd5-95e6-50c04f118ee5 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Getting quotas for user 7447ba5f53114d278711dccc0aa1ad07 and project 01c16f8389774f4c94889a562cdd38f9. Resources: {'key_pairs'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:50:31.048112 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9c6702ae-6125-4bd5-95e6-50c04f118ee5 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.300945 Aug 29 22:50:31.048729 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 529/1066] 10.222.0.77 () {60 vars in 1159 bytes} [Mon Aug 29 22:50:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:37.490801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:37.493163 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.495426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=37 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.496111 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=49 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.502106 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.502594 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.503062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.503813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.504271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.504699 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.589996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6ace1989-465f-47f2-aa95-d96ccc14b25e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action" status: 202 len: 0 microversion: 2.1 time: 0.102835 Aug 29 22:50:37.590668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 538/1067] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:37 2022] POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:50:37.599775 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.601162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.610875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.611361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.611804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.612520 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.612983 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.613411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.877826 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:37.890298 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-51e2f03e-fce8-4664-bbe7-30386d3d6d44 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1751 microversion: 2.1 time: 0.294618 Aug 29 22:50:37.890932 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 530/1068] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1751 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:38.915459 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.916803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.924634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.925135 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.925573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.926292 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.926773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.927299 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.110368 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.120624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-35e26711-7902-4bd9-befd-46b4ab1d8941 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.210300 Aug 29 22:50:39.121274 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 539/1069] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:40.150647 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.151720 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.162961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.163853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.165543 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.165923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.166793 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.167584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.381434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.390286 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-48d7a22a-c542-4d5f-8513-d5b9c27df40e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.246738 Aug 29 22:50:40.390920 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 531/1070] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:41.417756 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.418391 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.426226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.426449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.426449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.426449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.426449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.429315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.602148 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:41.611539 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4ac61f63-0bd3-4ee2-a5d0-789cb775d69b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.197688 Aug 29 22:50:41.612117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 540/1071] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:42.633635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.636137 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.637598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:42.642301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.643099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.644053 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.645266 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.645986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.646623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.824016 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.834079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8365c2e6-801d-499b-82d0-3d28f7e5cccc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.203922 Aug 29 22:50:42.834617 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 532/1072] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:43.857817 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.858444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.865129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.865611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.866046 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.866773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.867226 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.867647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.026171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.035051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c0d009f7-ee86-4746-a913-ccf4688a911a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.181056 Aug 29 22:50:44.035610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 541/1073] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:45.059690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.060646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.068635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.069163 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.069598 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.070296 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.070754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.071246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.238987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:45.248268 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c5d2fd08-7e89-480d-a32f-800e24070bc8 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.193613 Aug 29 22:50:45.248833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 533/1074] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:46.270604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.271280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.279493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.279978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.280418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.281121 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.281575 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.282011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.429582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.437782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8e4b50d9-07f9-45b3-80f9-f6306ce0779a tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.171071 Aug 29 22:50:46.438352 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 542/1075] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:47.460081 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.460750 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.467888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.468666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.469102 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.470093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.470437 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.470953 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.740638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.750359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-44b71286-debf-4db6-aff3-e59f3751ad99 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.294232 Aug 29 22:50:47.751135 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 534/1076] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:48.772086 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.772783 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.779960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.780443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.780887 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.781671 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.782069 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.782497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.812124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1604849929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1741155288", "security_groups": [{"name": "tempest-secgroup-smoke-1351019154"}], "networks": [{"uuid": "dd592014-20a1-45d6-9a2e-33340181b90d"}], "block_device_mapping_v2": [{"uuid": "1cfeb0a3-e096-46c4-bc72-ad510f3fb23b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:48.997417 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] validate_networks() for [('dd592014-20a1-45d6-9a2e-33340181b90d', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:50:49.091053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.099824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0315f081-a363-45e3-97af-5e4fffdbbc3b tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.331782 Aug 29 22:50:49.100426 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 543/1077] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:49.398633 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:50:49.399124 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:50:49.399599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:50:49.400039 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:50:49.400450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:50:49.409149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.409627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.410064 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.410816 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.411269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.411690 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.428764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Getting quotas for project 01c16f8389774f4c94889a562cdd38f9. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:50:49.433404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Getting quotas for user 7447ba5f53114d278711dccc0aa1ad07 and project 01c16f8389774f4c94889a562cdd38f9. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:50:49.490213 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:50:49.492375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1cfeb0a3-e096-46c4-bc72-ad510f3fb23b',volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:50:49.620782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fb864757-445f-4538-adde-9157ed6c4c57 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812215 Aug 29 22:50:49.621429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 535/1078] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:50:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:50:49.633129 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-521176e9-2ab1-43fe-a625-6cbc18700e84 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.633987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-521176e9-2ab1-43fe-a625-6cbc18700e84 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.688451 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-521176e9-2ab1-43fe-a625-6cbc18700e84 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.695384 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-521176e9-2ab1-43fe-a625-6cbc18700e84 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1089 microversion: 2.1 time: 0.066678 Aug 29 22:50:49.695967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 544/1079] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:50.122905 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.124086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.132361 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.132841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.133276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.134009 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.134489 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.134944 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.312288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.320989 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2eab33da-0e12-46cd-ba24-a7c48028096e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.203024 Aug 29 22:50:50.321549 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 536/1080] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:50.716772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.717425 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.724657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.725142 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.725574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.726275 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.726719 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.727451 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.818006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.829283 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d7bd5a62-dcf5-4e89-a940-4c580639c1f9 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1195 microversion: 2.1 time: 0.117201 Aug 29 22:50:50.829856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 545/1081] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1195 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:51.344130 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.345062 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.351466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.351945 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.352628 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.353429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.353878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.354297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.609376 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:51.618235 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a5c5fb02-ee84-4023-9d9f-d2ca9d2f552e tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.279062 Aug 29 22:50:51.618919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 537/1082] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:51.850939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.851610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.858345 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.859287 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.859750 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.860452 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.860912 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.861326 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.078241 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.085945 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-94896f52-1f47-418d-9603-ddc096d0652c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.238906 Aug 29 22:50:52.086509 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 546/1083] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:52.232549 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:52.242115 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.242593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.243051 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.254667 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] Creating event network-changed:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:50:52.260341 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-b57e1668-5847-4b1b-b30b-118e676a01ba req-5823b4e1-d0ac-4956-8ce3-cb1ecc07f382 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 Aug 29 22:50:52.262142 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 538/1084] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:52.639870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.640400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.646394 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.646914 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.647351 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.648051 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.648507 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.648931 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.791624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.802515 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d9972400-b23b-48f3-8886-9cf451bd14dd tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.166506 Aug 29 22:50:52.807479 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 547/1085] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:52 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:53.108631 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.109309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.115401 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.115875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.116330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.117007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.117455 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.117874 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.247963 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.255483 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f722195a-aa2a-474f-b478-b3ab110a9f82 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.151587 Aug 29 22:50:53.256043 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 539/1086] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:53.829314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.829926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.836850 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.837329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.837860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.838556 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.839042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.839464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.987831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.000263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-684da76a-37b0-47ae-8e2d-ec20e43dab63 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1756 microversion: 2.1 time: 0.174671 Aug 29 22:50:54.002042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 548/1087] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:54.276839 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.277479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.284768 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.285275 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.285719 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.286432 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.286927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.287355 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.686744 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.695176 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-28273fc4-22d6-4168-b7f9-0820c4e9ddfd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.422086 Aug 29 22:50:54.695782 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 540/1088] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:55.023524 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.024154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.031572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.032104 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.032540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.033261 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.033705 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.034137 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.201236 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.210665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c172b347-3de1-494b-aa83-d04d9ec9070d tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1759 microversion: 2.1 time: 0.190874 Aug 29 22:50:55.211315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 549/1089] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:55.716393 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.717005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.724071 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.724716 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.725161 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.725872 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.726332 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.726791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.880403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.893330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-63e1e9aa-bbcb-418c-b711-6e39c6cf8d18 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.180662 Aug 29 22:50:55.894219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 541/1090] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:56.914572 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.915347 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.922084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.922568 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.923041 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.923743 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.924197 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.924624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.070062 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.079435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fa6b3f24-1b78-4da6-9370-3b12c43f8abd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.168630 Aug 29 22:50:57.080013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 550/1091] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:58.100997 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.101629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.108357 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.108841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.109279 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.109974 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.110430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.110925 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.255218 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:58.263070 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-ebad0e02-d7c1-4b5c-a337-f8fb398b63d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.166111 Aug 29 22:50:58.263890 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 542/1092] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:58.840623 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "name": "network-vif-plugged", "status": "completed", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:58.851666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.852186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.852580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.865632 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] Creating event network-vif-plugged:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:50:58.871560 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-421b9a23-d55f-4bf4-9671-62fa92eeff6c req-93c719c6-73ce-4695-a46f-05d76af0edb6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Aug 29 22:50:58.872158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 551/1093] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:59.283330 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.283917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.290207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.291243 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.291682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.292381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.292833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.293273 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.420914 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:59.425611 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:59.434144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-27d7dbdc-0c0e-43a7-9d7d-164f064f126f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.154686 Aug 29 22:50:59.434900 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 543/1094] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:00.452634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:00.457710 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.458404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.464762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.465238 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.465667 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.466346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.466831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.467249 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.621454 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.629463 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c7d87ec6-1a8e-4644-862d-9d8b0cdb89fc tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1261 microversion: 2.1 time: 0.177733 Aug 29 22:51:00.630035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 552/1095] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:01.649595 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.650785 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.652531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=6 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.653986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.659889 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.660369 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.660801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.661496 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.661950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.662373 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.665635 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=77 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.801181 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:01.809229 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d6d202a6-cf83-42f7-9860-12cad1add1bd tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1445 microversion: 2.1 time: 0.163543 Aug 29 22:51:01.809803 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 544/1096] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:01.829080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.829734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.836169 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.836654 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.837095 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.838308 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.838787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.839218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.990388 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:01.998268 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4c3273e2-d6c9-427c-b731-ac7b608e0fd4 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1445 microversion: 2.1 time: 0.173015 Aug 29 22:51:01.998895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 553/1097] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:04.252571 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:04.276793 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.278466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.278949 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.291678 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] Creating event network-changed:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:51:04.296933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-3ba2687d-836a-4aa4-9d58-daef8588ce56 req-fa847a66-2b97-45e2-bd0f-4193b67d4dcb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048793 Aug 29 22:51:04.297532 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 545/1098] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:30.707651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1128230593"}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:30.708233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.710663 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=34 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:30.711324 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:30.717802 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.718544 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.719004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.719715 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.720160 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.720574 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.855872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.network.security_group_api [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Removing security group 14e76dd2-8a30-4849-ad57-7c2430784d8e from port 8cec05bd-1e08-4f8e-a54b-ec0c947a77bf Aug 29 22:51:31.202782 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ae419db2-f907-4572-9ee7-65257e328d87 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action" status: 202 len: 0 microversion: 2.1 time: 0.498436 Aug 29 22:51:31.204034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 554/1099] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:51:30 2022] POST /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:51:31.231044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:31.233698 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=7 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:31.332302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:31.343865 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.344434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.344942 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.357141 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] Creating event network-changed:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:51:31.365063 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-ed73905d-7fa3-486a-82c1-cf20004a58e6 req-41f7b5cf-dcd0-4fc1-a94e-ffb5ea56cf0b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138477 Aug 29 22:51:31.366876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 546/1100] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:32.830490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.831098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.837588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.838073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.838502 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.839235 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.839718 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.840204 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.934154 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lazy-loading 'services' on Instance uuid 24cdb3bd-9f0f-43c6-a09d-aebd690b097b {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:51:33.037418 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4f8b5425-7eef-4528-9c75-7b9e4dba3769 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments/5c396ad1-9342-4111-a011-75ba83685657" status: 202 len: 0 microversion: 2.1 time: 0.211329 Aug 29 22:51:33.038080 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 555/1101] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:51:32 2022] DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments/5c396ad1-9342-4111-a011-75ba83685657 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:51:33.050167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.052669 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.060486 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.060978 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.061405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.062121 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.062572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.063026 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.096504 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c78dd5c7-ab23-455e-a464-cb2a43bea3e2 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050991 Aug 29 22:51:33.101254 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 547/1102] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:33.383174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:33.399505 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.400185 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.400797 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.417008 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] Creating event network-changed:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:51:33.423193 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-f544ecac-0c49-47b6-9a73-7aa2d22ee8da req-ff00d023-86b4-4182-94fb-7e4a956f0754 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044058 Aug 29 22:51:33.423803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 556/1103] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:34.110104 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.112437 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.118924 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.119406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.119836 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.120524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.120970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.121420 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.151321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d2b745b9-5900-470f-bca0-513de5c71d97 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045339 Aug 29 22:51:34.151875 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 548/1104] 10.222.0.77 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:51:34.163751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.164340 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.171697 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.172176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.172610 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.173363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.173893 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.174313 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.268882 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] HTTP exception thrown: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b is not attached to volume 5c396ad1-9342-4111-a011-75ba83685657 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Request method failure captured: Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments/5c396ad1-9342-4111-a011-75ba83685657 HTTP/1.1 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUJW-_IbGf5kHZIVXCSHXd4kUZ-Tw0DA_6az4-SZ2ADfW9uueCtQ8M7hL1hFZiOTrDO5XnoGeLkqCPliY46l5Mpru30aI9hJlGvK52tQBRZZ6AScNujcbXskq4KP1xDtmungEACHUrjg5DSzRYUInbDBFIMua6zV31bLQqeqk7rbed0 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: c814b0ae26d84c08b9c27e1f11d3b2ff Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:51:34.271860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c814b0ae26d84c08b9c27e1f11d3b2ff", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}] Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: c814b0ae26d84c08b9c27e1f11d3b2ff Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-TestMinimumBasicScenario-1121242568-project Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 9f7d298884b743f49760437628fc65aa Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-TestMinimumBasicScenario-1121242568-project Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:51:34.275053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b is not attached to volume 5c396ad1-9342-4111-a011-75ba83685657 Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'server_id': '24cdb3bd-9f0f-43c6-a09d-aebd690b097b', 'id': '5c396ad1-9342-4111-a011-75ba83685657'} Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c396ad1-9342-4111-a011-75ba83685657. Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:51:34.276290 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b is not attached to volume 5c396ad1-9342-4111-a011-75ba83685657 Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b is not attached to volume 5c396ad1-9342-4111-a011-75ba83685657 Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:34.280369 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Returning 404 to user: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b is not attached to volume 5c396ad1-9342-4111-a011-75ba83685657 {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:51:34.281479 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-4a1294dc-0732-43f9-b3e7-60192fd13eee tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments/5c396ad1-9342-4111-a011-75ba83685657" status: 404 len: 154 microversion: 2.1 time: 0.114819 Aug 29 22:51:34.281479 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 557/1105] 10.222.0.77 () {58 vars in 1416 bytes} [Mon Aug 29 22:51:34 2022] DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b/os-volume_attachments/5c396ad1-9342-4111-a011-75ba83685657 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:35.433824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.434380 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.441068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.441547 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.441986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.442675 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.443150 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.443575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.469083 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:51:35.546450 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-aec6f093-10db-4146-a533-eed85e161560 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 204 len: 0 microversion: 2.1 time: 0.116682 Aug 29 22:51:35.547143 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 549/1106] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:51:35 2022] DELETE /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:51:35.555994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.556621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.563311 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.563789 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.564217 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.564901 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.565348 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.565766 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.699214 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:35.706892 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6ee9c684-a6cb-422a-b668-d7ab5356ed23 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1553 microversion: 2.1 time: 0.155356 Aug 29 22:51:35.707457 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 558/1107] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:36.729829 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.730749 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.737198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.737676 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.738101 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.738831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.739282 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.739699 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.878692 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.886609 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-758ce11b-408f-465a-9f75-ab245c6af042 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1553 microversion: 2.1 time: 0.161657 Aug 29 22:51:36.887204 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 550/1108] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:37.875346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cdb3bd-9f0f-43c6-a09d-aebd690b097b", "name": "network-vif-deleted", "tag": "8cec05bd-1e08-4f8e-a54b-ec0c947a77bf"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:37.886775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.887662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.888194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.900978 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] Creating event network-vif-deleted:8cec05bd-1e08-4f8e-a54b-ec0c947a77bf for instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b on hv-cinder-85427 Aug 29 22:51:37.908263 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-98b565ec-708f-44ea-ba03-298a9c15f667 req-5a56e72d-9fcd-4ee0-b559-5d2ddd9cbeae service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Aug 29 22:51:37.909188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 559/1109] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:37.913790 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.915626 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.926638 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.927440 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.928470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.929704 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.930550 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.931346 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.021596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7d298884b743f49760437628fc65aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c814b0ae26d84c08b9c27e1f11d3b2ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:38.030262 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-76d58d85-657a-45e6-867e-bb205f0f6945 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 200 len: 1343 microversion: 2.1 time: 0.124113 Aug 29 22:51:38.030845 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 551/1110] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 1343 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:39.055792 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.057487 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] [instance: 24cdb3bd-9f0f-43c6-a09d-aebd690b097b] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.064579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.065060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.065494 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.066222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.066698 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.067151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.080435 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] HTTP exception thrown: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Request method failure captured: Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b HTTP/1.1 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUJW-_IbGf5kHZIVXCSHXd4kUZ-Tw0DA_6az4-SZ2ADfW9uueCtQ8M7hL1hFZiOTrDO5XnoGeLkqCPliY46l5Mpru30aI9hJlGvK52tQBRZZ6AScNujcbXskq4KP1xDtmungEACHUrjg5DSzRYUInbDBFIMua6zV31bLQqeqk7rbed0 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: c814b0ae26d84c08b9c27e1f11d3b2ff Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:51:39.081987 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c814b0ae26d84c08b9c27e1f11d3b2ff", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c814b0ae26d84c08b9c27e1f11d3b2ff"}]}] Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: c814b0ae26d84c08b9c27e1f11d3b2ff Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1121242568 Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-TestMinimumBasicScenario-1121242568-project Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 9f7d298884b743f49760437628fc65aa Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-TestMinimumBasicScenario-1121242568-project Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. Aug 29 22:51:39.084467 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '24cdb3bd-9f0f-43c6-a09d-aebd690b097b'} Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:51:39.086108 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. Aug 29 22:51:39.089607 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:51:39.092252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Returning 404 to user: Instance 24cdb3bd-9f0f-43c6-a09d-aebd690b097b could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:51:39.092252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-fc4cc243-fb9c-4d59-bb0b-5118276ee439 tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b" status: 404 len: 111 microversion: 2.1 time: 0.035105 Aug 29 22:51:39.092252 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 560/1111] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/24cdb3bd-9f0f-43c6-a09d-aebd690b097b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:39.095409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-50a92ffa-9182-4d78-9b05-b1a75d2315dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] Calling method '.version_select at 0x7f5cf6cd21f0>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.120822 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-50a92ffa-9182-4d78-9b05-b1a75d2315dc tempest-TestMinimumBasicScenario-1121242568 tempest-TestMinimumBasicScenario-1121242568-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1630077036" status: 202 len: 0 microversion: 2.1 time: 0.031322 Aug 29 22:51:39.121406 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 552/1112] 10.222.0.77 () {58 vars in 1272 bytes} [Mon Aug 29 22:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1630077036 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:52:03.800936 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.801603 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.804250 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=14 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.804979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.811702 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.812199 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.812633 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.813337 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.813794 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.814222 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.841885 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:52:03.934206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6f14a7ca-b3bf-451e-9162-a9f7ee9db938 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 204 len: 0 microversion: 2.1 time: 0.136355 Aug 29 22:52:03.934949 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 561/1113] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:52:03 2022] DELETE /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:52:03.941315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.942057 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.946434 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.947185 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.956531 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.957015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.957448 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.958149 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.958608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.959068 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.103209 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:04.112490 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-12856012-0f83-4009-83af-efab96019eb9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1576 microversion: 2.1 time: 0.172867 Aug 29 22:52:04.113074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 553/1114] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:05.137791 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:05.138589 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:05.145830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.146315 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.146915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.147725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.148184 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.148604 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.314961 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:05.326510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-88ddc1ff-caf5-446f-bf53-7d575f34939b tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1576 microversion: 2.1 time: 0.196129 Aug 29 22:52:05.327269 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 562/1115] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:05 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:06.351021 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:06.351799 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:06.368475 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.369226 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.369859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.371365 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.371986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.372570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.464007 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0919031f-4373-45d3-b94e-29635868fcac", "name": "network-vif-deleted", "tag": "0e27f728-d25a-4c36-8bb7-06a74c15089c"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:06.476370 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.476865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.477280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.489863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:06.490443 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] Creating event network-vif-deleted:0e27f728-d25a-4c36-8bb7-06a74c15089c for instance 0919031f-4373-45d3-b94e-29635868fcac on hv-cinder-85427 Aug 29 22:52:06.497053 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-0028a1d5-aec3-4304-a7dc-9d62a82907d5 req-b30f3b67-f68e-4b33-a0bc-7063d4caff38 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036921 Aug 29 22:52:06.497545 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 563/1116] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:06.503098 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-1370b485-b4be-48d3-a6b9-2a6e55a5fc35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 200 len: 1508 microversion: 2.1 time: 0.156370 Aug 29 22:52:06.504646 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 554/1117] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:07.526456 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.527833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.534058 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.534543 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.535014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.535711 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.536164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.536688 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.551813 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] HTTP exception thrown: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Request method failure captured: Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac HTTP/1.1 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUJXRUveNDYBMOeF0DzxKsLTiOLJ2M7NaJmvobXOF4voiWBy-HfILf1wNdCUI95tBku9SA-a8yUXRD5078i16mjqZMWJBcPu1WLreFq4T1DF0iVqiQfBLt_apM7F8_xUcbkF_bkdY8EseDWn7yXQ9nQLbQqVSlZ8HBWJH3cNpP0bOXs Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:52:07.553478 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/36e090f60dd244cea327de965ad9af13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_36e090f60dd244cea327de965ad9af13", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}] Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 1addff9d7c7348de827c4eba89d41660 Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:52:07.555282 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '0919031f-4373-45d3-b94e-29635868fcac'} Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:52:07.556328 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:52:07.558023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:52:07.559694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Returning 404 to user: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:52:07.559694 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d298604e-8deb-4978-8bf0-d431e41e6523 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 404 len: 111 microversion: 2.1 time: 0.033180 Aug 29 22:52:07.563735 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 564/1118] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:07 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:52:07.664793 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1157936347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-672647324", "security_groups": [{"name": "tempest-secgroup-smoke-1584453056"}], "block_device_mapping_v2": [{"uuid": "2b2b8d96-e3c8-4bd8-95fd-6f06dacd34ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97336a57-5879-42cd-b56c-34e6fb04c8c0"}]}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:07.782894 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.network.neutron [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] validate_networks() for [('97336a57-5879-42cd-b56c-34e6fb04c8c0', None, None, None, None, None)] {{(pid=148456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:52:08.171135 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:52:08.171562 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image limits 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:52:08.172034 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:52:08.172442 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image pref 0:0:0 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:52:08.172853 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.virt.hardware [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:52:08.181686 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.182165 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.182603 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.183971 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.184452 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.184882 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.201337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:52:08.205801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.quota [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for user 1addff9d7c7348de827c4eba89d41660 and project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:52:08.264680 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Going to run 1 instances... {{(pid=148456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:52:08.266863 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b2b8d96-e3c8-4bd8-95fd-6f06dacd34ba',volume_size=None,volume_type=None)] {{(pid=148456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:52:08.395973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5563a687-4d02-4760-9d17-90eaba847bb7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735001 Aug 29 22:52:08.396612 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 555/1119] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:52:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:52:08.409167 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3afc1549-3e63-48b1-a94b-7868085d0d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.409926 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3afc1549-3e63-48b1-a94b-7868085d0d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.467640 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3afc1549-3e63-48b1-a94b-7868085d0d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:08.475200 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3afc1549-3e63-48b1-a94b-7868085d0d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1094 microversion: 2.1 time: 0.069905 Aug 29 22:52:08.475965 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 565/1120] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:09.497878 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-2479255c-91e0-444c-9d52-a9ebd46d80c5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.498608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-2479255c-91e0-444c-9d52-a9ebd46d80c5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.554525 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-2479255c-91e0-444c-9d52-a9ebd46d80c5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:09.562108 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-2479255c-91e0-444c-9d52-a9ebd46d80c5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1094 microversion: 2.1 time: 0.068078 Aug 29 22:52:09.562677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 556/1121] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:10.583158 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-dd2f186e-21dc-4454-b326-939e31ded3d7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.583725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-dd2f186e-21dc-4454-b326-939e31ded3d7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.642700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-dd2f186e-21dc-4454-b326-939e31ded3d7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:10.650377 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-dd2f186e-21dc-4454-b326-939e31ded3d7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1094 microversion: 2.1 time: 0.071177 Aug 29 22:52:10.651128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 566/1122] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:11.672752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-20e962b5-d7dd-4048-8feb-9629dd0861be tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.674116 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-20e962b5-d7dd-4048-8feb-9629dd0861be tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.729122 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-20e962b5-d7dd-4048-8feb-9629dd0861be tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:11.736702 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-20e962b5-d7dd-4048-8feb-9629dd0861be tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1094 microversion: 2.1 time: 0.068266 Aug 29 22:52:11.737293 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 557/1123] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:12.757890 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.758489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.764967 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.765439 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.765868 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.766549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.767027 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.767455 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.830136 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:12.838004 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3b8f33be-d9a9-439c-8faf-377813b69a78 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1144 microversion: 2.1 time: 0.084070 Aug 29 22:52:12.838565 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 567/1124] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:13.863133 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.864428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.873773 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.874177 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.874795 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.875482 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.875957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.876411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.962967 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:13.972651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-8e45e7f4-228e-4daf-bb9f-7835ac1e95a5 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1210 microversion: 2.1 time: 0.115604 Aug 29 22:52:13.973652 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 558/1125] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:14.996110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.996765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.010600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.011035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.012052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.012954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.013420 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.013831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.159628 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:15.160812 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167fe5d0-c858-41ff-94ea-02ee2efb1848", "tag": "d43fa887-48db-44e4-b027-1e329db78c04"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:15.168758 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-096a893e-4cb1-4e9d-8ab0-d195b2ed8f9e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.176833 Aug 29 22:52:15.169939 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 568/1126] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:15.172809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.173580 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.174840 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.187672 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] Creating event network-changed:d43fa887-48db-44e4-b027-1e329db78c04 for instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 on hv-cinder-85427 Aug 29 22:52:15.197191 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-d158dee1-2c1b-413f-9f46-90332d9f6edf req-1c923bf1-1985-4572-92aa-22702b8f098f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193635 Aug 29 22:52:15.198012 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 559/1127] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:16.190116 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.190760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.198860 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.199408 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.199848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.200548 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.201006 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.201433 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.340113 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.348090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-890613b3-d509-4ab2-a4d0-04839cd3a898 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.161798 Aug 29 22:52:16.348646 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 569/1128] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:17.369852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.370530 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.377433 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.377904 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.378328 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.379114 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.379563 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.379982 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.510649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:17.518402 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f0743080-ca55-4ecf-8b62-e82f9b16ca45 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.153182 Aug 29 22:52:17.518987 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 560/1129] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:18.539144 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.539706 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.546751 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.547240 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.547673 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.548378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.548826 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.549245 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.687098 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:18.694761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-6488437e-7773-4c58-8fda-5291bfac113c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.159690 Aug 29 22:52:18.695330 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 570/1130] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:19.716217 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:19.716916 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.719055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.725246 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.725730 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.726167 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.726894 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.727351 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.727776 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.869117 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:19.877085 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-9f75461e-b6ad-40ef-beca-1b18e6f7ad1a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.165361 Aug 29 22:52:19.877657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 561/1131] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:19 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:20.898205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.898829 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.901202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=4 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:20.906890 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.907362 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.907788 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.908471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.908915 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.909331 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.042691 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:21.050696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7cee6561-c137-4651-a278-6f7b93bbf4ab tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.156320 Aug 29 22:52:21.051288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 571/1132] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:22.071671 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.072223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.075616 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=10 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:22.082592 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.083192 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.083622 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.084317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.084764 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.085183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.216727 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:22.224632 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-51feb914-c8dd-4841-b32b-7ea7a5bce21e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.156863 Aug 29 22:52:22.225198 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 562/1133] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:23.246869 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.247473 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.254076 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.254519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.255094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.255793 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.256303 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.258110 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.400449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:23.409218 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0c9138ae-f56e-473a-a85b-1d0c59c4fc1e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.166220 Aug 29 22:52:23.409781 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 572/1134] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:24.430772 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.431347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.438438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.438964 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.439405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.440099 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.440552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.440975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.575769 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:24.583811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-98dabb61-bd4e-4fae-95b7-23808c28a59f tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.157056 Aug 29 22:52:24.584599 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 563/1135] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:25.305700 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167fe5d0-c858-41ff-94ea-02ee2efb1848", "name": "network-vif-plugged", "status": "completed", "tag": "d43fa887-48db-44e4-b027-1e329db78c04"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:25.315555 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.316052 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.316474 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.327725 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] Creating event network-vif-plugged:d43fa887-48db-44e4-b027-1e329db78c04 for instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 on hv-cinder-85427 Aug 29 22:52:25.332822 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-adad1c3d-3e06-4cb4-ab86-ea1e684951db req-7a670138-f3f3-410b-ac17-45adf81813e8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092707 Aug 29 22:52:25.333346 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 573/1136] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:25.605030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:25.605780 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:25.611990 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.612474 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.612910 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.613606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.614065 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.614494 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.742207 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:25.750387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-fc848bf4-1388-4a73-b31a-79491c1d6367 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1266 microversion: 2.1 time: 0.149249 Aug 29 22:52:25.750968 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 564/1137] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:25 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:26.772170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.772872 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.780338 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.780816 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.781257 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.781946 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.782400 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.782900 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.922588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:26.930231 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-86ef2cf8-73b8-4c0d-a994-13be1ca0a89c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1451 microversion: 2.1 time: 0.162328 Aug 29 22:52:26.930811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 574/1138] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:26.950856 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.951470 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.957381 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.957865 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.958301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.959018 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.959476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.959906 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.093044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:27.101030 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-0383401d-b022-46d3-bad0-7f07c97ade24 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1451 microversion: 2.1 time: 0.154248 Aug 29 22:52:27.101600 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 565/1139] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:29.007848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167fe5d0-c858-41ff-94ea-02ee2efb1848", "tag": "d43fa887-48db-44e4-b027-1e329db78c04"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:29.017648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.018138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.018586 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.030139 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] Creating event network-changed:d43fa887-48db-44e4-b027-1e329db78c04 for instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 on hv-cinder-85427 Aug 29 22:52:29.035385 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-9a3f34b1-1aa3-4a03-9a27-6e020576e38e req-da5d7090-617a-46e0-a01d-9d0b9bce3809 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031104 Aug 29 22:52:29.036172 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 575/1140] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:01.701430 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:01.702125 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.704334 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.705040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=58 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.710439 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.711007 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.711454 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.712183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.712643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.713079 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.740578 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.objects.instance [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lazy-loading 'flavor' on Instance uuid 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 {{(pid=148456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:01.823998 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e2fd32a8-e78f-4155-82ad-35669f5bd476 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "POST /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5/action" status: 202 len: 0 microversion: 2.1 time: 0.127006 Aug 29 22:53:01.824614 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 566/1141] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:53:01 2022] POST /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:01.833803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.834554 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.836960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.837634 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.844332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.844830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.845254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.845973 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.846431 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.846889 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.007736 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.016090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-8fd94603-f971-4d92-af3e-a1f60f2c77c3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.186647 Aug 29 22:53:02.016682 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 576/1142] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:03.038154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.038913 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.050708 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.051228 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.051661 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.052374 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.052820 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.053238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.189732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.197809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-17d917cc-702a-4ae9-b184-65b31c3fea70 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.163891 Aug 29 22:53:03.198390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 567/1143] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:04.220954 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.221516 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.228243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.228723 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.229152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.229909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.230424 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.231071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.382564 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.390798 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-636cad7e-cdec-4230-8965-2b532b5bb645 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.174010 Aug 29 22:53:04.391427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 577/1144] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:05.414558 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.415231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.422162 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.422641 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.423093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.423779 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.424317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.424808 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.558933 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.566649 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-a4f85721-2559-48bb-a115-9a2fe25d06a3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.157768 Aug 29 22:53:05.567260 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 568/1145] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:06.588772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.589357 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.597716 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.598198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.598640 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.599372 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.599830 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.600256 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.737068 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:06.745132 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-13df61de-1069-460e-b445-c1bdb1e9dc83 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.160339 Aug 29 22:53:06.746219 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 578/1146] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:07.765976 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:07.766571 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:07.773610 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.774118 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.774566 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.775276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.775725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.776144 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.916232 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:07.924093 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-887efdf5-4a3c-4da5-991a-273a3293a212 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.161987 Aug 29 22:53:07.924657 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 569/1147] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:08.944842 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.945510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.952689 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.953182 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.953616 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.954314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.954801 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.955228 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.101254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:09.112874 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-18afae1d-e542-4299-bea6-8e323778f548 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.171899 Aug 29 22:53:09.113755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 579/1148] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:08 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:10.135251 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.135809 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.142126 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.142602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.143069 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.143754 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.144234 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.144629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.283901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:10.291851 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-665fb67c-6b69-42d6-967b-90646236a2e2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.160531 Aug 29 22:53:10.292411 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 570/1149] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:11.313437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.314060 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.320843 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.321320 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.321744 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.322442 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.322924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.323341 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.460393 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:11.474472 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-7e1703db-f73e-4c94-8d4e-937f3b5158d2 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.164494 Aug 29 22:53:11.475497 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 580/1150] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:12.509399 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:12.510082 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:12.516927 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.517540 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.517980 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.518685 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.519219 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.519650 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.652596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:12.660732 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b4c8050d-719d-4717-b336-c2f70f88271c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.155347 Aug 29 22:53:12.661310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 571/1151] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:12 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:13.682170 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.682803 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.689835 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.690319 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.690777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.691480 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.691941 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.692363 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.824526 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:13.832530 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-c90c61b3-f696-44db-9f48-f52fc1144e75 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.154293 Aug 29 22:53:13.833092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 581/1152] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:14.853789 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.854400 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.861327 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.861801 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.862230 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.862950 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.863392 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.863804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.995134 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:15.003364 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b9e2e8d9-1dc0-44f9-8b9a-6d2abfea5275 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1511 microversion: 2.1 time: 0.153428 Aug 29 22:53:15.003923 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 572/1153] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:15.023979 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:15.024579 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.031198 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.031538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.031975 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.032668 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.033123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.033550 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.061824 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=148457) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:53:15.126437 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-df95c0f2-581f-425b-9be4-560a5831a832 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "POST /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5/action" status: 202 len: 0 microversion: 2.1 time: 0.106237 Aug 29 22:53:15.127085 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 582/1154] 10.222.0.77 () {60 vars in 1278 bytes} [Mon Aug 29 22:53:15 2022] POST /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:15.136660 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:15.138005 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.145885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.146565 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.147278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.148317 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.148970 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.149575 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.321422 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:15.329725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-13f3d81a-207f-4bda-911c-5539a173f433 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1519 microversion: 2.1 time: 0.198061 Aug 29 22:53:15.330301 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 573/1155] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:15 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:16.351140 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.351985 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.358895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.359428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.359862 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.360576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.361023 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.361441 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.496834 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:16.504653 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b1663e4f-7824-4558-a983-673a26baf860 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1521 microversion: 2.1 time: 0.157805 Aug 29 22:53:16.505234 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 583/1156] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:17.387414 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "name": "network-vif-unplugged", "status": "completed", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:17.398811 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.399356 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.399779 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.411713 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] Creating event network-vif-unplugged:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:53:17.417608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-45188b2f-0c25-483a-a1a5-e9ed15bda148 req-a1c954de-50b8-4078-8e90-13e0a04adce5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033628 Aug 29 22:53:17.418857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 574/1157] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:17.525787 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.526404 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.533432 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.533833 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.534286 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.535013 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.535468 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.535898 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.670471 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:17.678156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-b89152b9-17ab-4303-b942-8c9cfeb9fec3 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.156294 Aug 29 22:53:17.678710 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 584/1158] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:18.699465 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.700072 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.706915 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.707404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.707841 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.708552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.709008 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.709466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.844533 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:18.855224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-35a19f4b-3dc0-420c-afa4-4b06540e8244 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.160045 Aug 29 22:53:18.855865 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 575/1159] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:19.877261 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.877888 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.884254 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.884734 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.885171 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.885863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.886314 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.886764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.264863 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:20.272739 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d8d36d46-2e0b-4af0-92c3-f329a7764f41 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.399234 Aug 29 22:53:20.273300 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 585/1160] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:21.293431 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.294036 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.300688 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.301185 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.301613 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.302320 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.302802 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.303233 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.444123 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:21.452752 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5c9216d9-574d-47c4-ac0e-792d62e3c75c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.163140 Aug 29 22:53:21.453329 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 576/1161] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:22.477035 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.477657 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.484380 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.484865 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.485297 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.485994 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.486449 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.486919 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.617648 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:22.625298 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-43aab62e-509c-4d4a-95ef-b3d9cb786efa tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.152375 Aug 29 22:53:22.625864 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 586/1162] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:23.649015 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.649582 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.656091 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.656570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.657006 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.657695 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.658152 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.658571 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.793438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:23.801309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-3f85f5fc-f7c4-47c3-b319-2d8b54292bb8 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1577 microversion: 2.1 time: 0.158350 Aug 29 22:53:23.801877 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 577/1163] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:24.828980 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.829588 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.837089 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.837566 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.838176 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.839048 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.839499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.839920 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.982713 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:24.990773 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2ad7c3a2-a74f-46c1-a564-9d3130794416 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1564 microversion: 2.1 time: 0.166283 Aug 29 22:53:24.991336 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 587/1164] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:27.521350 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "name": "network-vif-plugged", "status": "completed", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:27.532161 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.532670 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.533140 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.544521 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] Creating event network-vif-plugged:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:53:27.550040 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-6e549d49-a7de-49b7-b2ac-cfac2a1482f5 req-feb03085-790c-4582-9ce3-195168297b32 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032601 Aug 29 22:53:27.550629 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 578/1165] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:05.374342 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-835717411", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-672647324", "security_groups": [{"name": "tempest-secgroup-smoke-1584453056"}], "block_device_mapping_v2": [{"uuid": "b271c485-2b1b-46cc-a1fb-757e0b5c4a7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97336a57-5879-42cd-b56c-34e6fb04c8c0"}]}} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:05.385756 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:05.386427 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:05.510049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.network.neutron [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] validate_networks() for [('97336a57-5879-42cd-b56c-34e6fb04c8c0', None, None, None, None, None)] {{(pid=148457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:54:05.926014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:54:05.926599 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image limits 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:54:05.927123 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Flavor pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:54:05.927538 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Image pref 0:0:0 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:54:05.927953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.virt.hardware [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=148457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:54:05.937659 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.938134 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.938567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.939327 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.939777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.941071 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.958925 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:54:05.963500 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.quota [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Getting quotas for user 1addff9d7c7348de827c4eba89d41660 and project 36e090f60dd244cea327de965ad9af13. Resources: {'instances', 'cores', 'ram'} {{(pid=148457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:54:06.029514 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Going to run 1 instances... {{(pid=148457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:54:06.031679 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b271c485-2b1b-46cc-a1fb-757e0b5c4a7c',volume_size=None,volume_type=None)] {{(pid=148457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:54:06.188244 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-65406de0-4001-4821-9543-c74da3d38d08 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818033 Aug 29 22:54:06.188895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 588/1166] 10.222.0.77 () {60 vars in 1147 bytes} [Mon Aug 29 22:54:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:54:06.200883 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4697bece-78ca-4523-bc77-494834f4c080 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.201645 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4697bece-78ca-4523-bc77-494834f4c080 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.206957 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=26 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:06.208280 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:06.281363 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4697bece-78ca-4523-bc77-494834f4c080 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:06.290524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4697bece-78ca-4523-bc77-494834f4c080 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1093 microversion: 2.1 time: 0.093410 Aug 29 22:54:06.291574 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 579/1167] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:07.320909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:07.321647 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:07.330490 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.331082 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.331519 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.332271 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.332742 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.333180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.419034 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:07.428044 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-aeadbf37-a892-41a2-a2cf-6ff5f28f9aba tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1199 microversion: 2.1 time: 0.114657 Aug 29 22:54:07.429561 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 589/1168] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:07 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:08.515677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.516315 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.523911 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.524408 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.524849 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.525584 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.526038 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.526683 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.671606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:08.687762 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-b5265eb1-ab65-4e0d-ab92-d97dc225174a tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.241302 Aug 29 22:54:08.688827 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 580/1169] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:08.870909 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6", "tag": "785e7f22-36b3-4a26-9362-7942d91504b7"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:08.890114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.891205 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.892542 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.912189 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] Creating event network-changed:785e7f22-36b3-4a26-9362-7942d91504b7 for instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 on hv-cinder-85427 Aug 29 22:54:08.918174 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-851e3b9e-121b-497f-8da0-974448b1f515 req-d64acf1c-1483-4262-82da-4d5e3cd4b211 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057250 Aug 29 22:54:08.919138 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 590/1170] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:09.710245 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.710917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.717429 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.717913 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.718624 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.719347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.719798 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.720224 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.866947 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:09.880804 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-75861e6c-3f5d-4896-b8f7-6071bd1fa7b7 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.174564 Aug 29 22:54:09.881899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 581/1171] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:10.904821 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.905666 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.912156 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.912638 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.913073 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.913764 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.914215 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.914669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.047486 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:11.055665 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-df739c21-079a-4e62-bd35-2561d23fbffd tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.156479 Aug 29 22:54:11.056239 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 591/1172] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:12.077223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.077770 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.084347 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.084831 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.085276 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.085975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.086428 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.086897 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.235423 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:12.244090 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-6eaa5a04-d48a-45ae-bed7-8314d7ac7303 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.170829 Aug 29 22:54:12.244666 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 582/1173] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:13.265933 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.266544 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.273084 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.273573 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.274011 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.274768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.275196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.275624 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.418621 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:13.426895 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3b434316-9f21-4e7c-be21-99974013cd7e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.165982 Aug 29 22:54:13.427464 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 592/1174] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:14.448223 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:14.448778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:14.455189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.456292 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.456729 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.457426 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.457876 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.458295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.595160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:14.603000 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-06b40360-73f4-477a-bfca-06a7cba7ffc3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.158660 Aug 29 22:54:14.603570 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 583/1175] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:14 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:15.629729 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:15.630294 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:15.636927 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.637444 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.637878 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.638580 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.639067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.639492 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.803194 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:15.814128 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-28c3c1fe-6e47-498a-b192-51432921477e tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.188360 Aug 29 22:54:15.815042 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 593/1176] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:15 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:16.835403 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.836012 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.838404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell0:SELECT=2 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:16.844278 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.844760 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.845193 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.845888 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.846336 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.846787 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.997640 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:17.007337 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-41b22ef9-edac-430b-8fe3-2d9aaee6d6d3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.176368 Aug 29 22:54:17.007919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 584/1177] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:18.028233 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.029202 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.030848 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=2 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:18.031506 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell0:SELECT=6 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:18.037996 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.038476 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.038951 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.039761 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.040175 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.040597 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.188395 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:18.196662 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0d5e1f3c-78c9-4a5f-a3ac-18a288f776fe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.172420 Aug 29 22:54:18.197243 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 594/1178] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:18 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:19.218884 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.219447 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.226630 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.227154 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.227597 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.228308 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.228767 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.229215 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.371502 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:19.379859 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-77068065-b83a-4bff-8f85-850136b00fae tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.165446 Aug 29 22:54:19.380427 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 585/1179] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:19.865173 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6", "name": "network-vif-plugged", "status": "completed", "tag": "785e7f22-36b3-4a26-9362-7942d91504b7"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:19.875152 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.875635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.876074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.889831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] Creating event network-vif-plugged:785e7f22-36b3-4a26-9362-7942d91504b7 for instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 on hv-cinder-85427 Aug 29 22:54:19.897196 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-9a1b2d54-7dad-4bee-8942-7154bd4d4eee req-5c3acbea-fc64-4165-ac67-534c0d39cd01 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Aug 29 22:54:19.897831 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 595/1180] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:20.401074 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:20.401677 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.408302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.408791 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.409227 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.410559 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.411046 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.411479 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.561738 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:20.571041 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-5faf1397-62f0-454d-a3c8-4a76a4a88a12 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1265 microversion: 2.1 time: 0.173931 Aug 29 22:54:20.571627 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 586/1181] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:20 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:21.596114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.596811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.603373 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.603857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.604288 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.604990 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.605442 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.605862 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.745639 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.754105 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-3c37df23-c6b9-41e8-9efd-ecefbe74ecf6 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1450 microversion: 2.1 time: 0.162700 Aug 29 22:54:21.754675 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 596/1182] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:21.774110 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.774928 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.781272 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.781755 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.782183 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.782908 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.783390 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.783807 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.922288 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.931044 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4626cb97-ed15-4e23-926c-dd9f82d62a43 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1450 microversion: 2.1 time: 0.160655 Aug 29 22:54:21.931765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 587/1183] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:23.849067 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6", "tag": "785e7f22-36b3-4a26-9362-7942d91504b7"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:23.859096 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.859578 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.860016 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.872549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] Creating event network-changed:785e7f22-36b3-4a26-9362-7942d91504b7 for instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 on hv-cinder-85427 Aug 29 22:54:23.879309 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-d0b837e2-105b-496c-a807-79819ec9a502 req-c232f089-5e5f-4a44-bc10-6c7273013b53 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033336 Aug 29 22:54:23.880041 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 597/1184] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:42.437359 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.437936 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:42.442094 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.442861 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=44 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.447269 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=20 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.447919 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=48 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.450768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:42.464797 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.465375 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.466524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.467014 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.467467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.467886 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.474090 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.474910 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.475672 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.492970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] Creating event network-changed:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:54:42.495852 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Going to try to terminate instance {{(pid=148456) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:54:42.498038 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-fb44217a-bb5d-4e3b-8211-d411d41cb01d req-6594c354-26be-40e9-9b1d-f84e0eabeed1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057807 Aug 29 22:54:42.499092 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 598/1185] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:42.605725 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-bc0e4c8f-cc5a-4530-9b19-8a8a0d644463 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 204 len: 0 microversion: 2.1 time: 0.172043 Aug 29 22:54:42.606682 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 588/1186] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:54:42 2022] DELETE /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:54:42.616811 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.617748 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:42.624422 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.624957 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.625447 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.626117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.626567 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.627012 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.777206 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.785970 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-d1ad6158-c83b-4957-9037-29820675b5a7 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.173296 Aug 29 22:54:42.786549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 599/1187] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:42 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:43.809602 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:43.810302 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.817476 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.817973 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.818552 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.819620 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.820225 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.820857 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.968295 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.978765 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d4a3d5a6-319a-4fca-ac69-8e7696a63f2c tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1570 microversion: 2.1 time: 0.173660 Aug 29 22:54:43.979404 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 589/1188] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:43 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:44.652777 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7dbfb1-8908-48a9-acd5-3c1a732e18c5", "name": "network-vif-deleted", "tag": "db295e97-639a-4af6-bccc-cab485b31df6"}]} {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:44.662847 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.663334 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.663768 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.675074 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.compute.server_external_events [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] Creating event network-vif-deleted:db295e97-639a-4af6-bccc-cab485b31df6 for instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 on hv-cinder-85427 Aug 29 22:54:44.679722 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [req-6c9bc9cc-f39b-4cbf-9ef7-f15f27ab3753 req-0a8e1dcf-2814-4bb1-99ae-4bba79dba391 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030582 Aug 29 22:54:44.680320 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 600/1189] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:45.000517 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:45.001275 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.009739 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.010466 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.010984 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.011867 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.012324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.012824 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.083022 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7447ba5f53114d278711dccc0aa1ad07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c16f8389774f4c94889a562cdd38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:45.090679 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-f9715e1f-677f-4af9-adcf-ecd22c53d90f tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 200 len: 1220 microversion: 2.1 time: 0.094171 Aug 29 22:54:45.091297 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 590/1190] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:46.112960 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:46.113651 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [instance: 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:46.120280 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.120759 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.121188 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.121884 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.122332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.122770 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.137014 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] HTTP exception thrown: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Request method failure captured: Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 HTTP/1.1 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUKwqkJubwylCsTjk5N-UoszEzHeQFSsLyIsTMWlQYFPxn2NedrAP9-z3mjA7AA9CW19CFnud8fVto5bfmtaa91_oSreimpBw8kNwoxzVuOpc4is3nMHTMs_TuAtGP1nMrLpMfS9ZuU_V9IqzP8-eJ5JCTnjMAPuLBqme9IwMK21X5M Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 01c16f8389774f4c94889a562cdd38f9 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-TestShelveInstance-795255872 Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:54:46.138669 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/01c16f8389774f4c94889a562cdd38f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_01c16f8389774f4c94889a562cdd38f9", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/01c16f8389774f4c94889a562cdd38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/01c16f8389774f4c94889a562cdd38f9"}]}] Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-TestShelveInstance-795255872 Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 01c16f8389774f4c94889a562cdd38f9 Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-TestShelveInstance-795255872 Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-TestShelveInstance-795255872-project Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 7447ba5f53114d278711dccc0aa1ad07 Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-TestShelveInstance-795255872-project Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. Aug 29 22:54:46.140390 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '4d7dbfb1-8908-48a9-acd5-3c1a732e18c5'} Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:54:46.141549 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. Aug 29 22:54:46.144305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:54:46.146049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Returning 404 to user: Instance 4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:54:46.146049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-0dff3261-4e0a-409b-afc7-d4754724ca62 tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5" status: 404 len: 111 microversion: 2.1 time: 0.031832 Aug 29 22:54:46.146049 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 601/1191] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:46 2022] GET /compute/v2.1/servers/4d7dbfb1-8908-48a9-acd5-3c1a732e18c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:54:46.325854 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-4b371043-4a6d-47e0-8274-eb83656d5add tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] Calling method '.version_select at 0x7f5cf6bd4f70>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:46.333387 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b371043-4a6d-47e0-8274-eb83656d5add tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [b72f91f3-9059-47ac-b2f3-3699dfc0db42] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 22:54:47.341899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b371043-4a6d-47e0-8274-eb83656d5add tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] [b72f91f3-9059-47ac-b2f3-3699dfc0db42] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 44314. Aug 29 22:54:47.363996 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-4b371043-4a6d-47e0-8274-eb83656d5add tempest-TestShelveInstance-795255872 tempest-TestShelveInstance-795255872-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1741155288" status: 202 len: 0 microversion: 2.1 time: 1.042926 Aug 29 22:54:47.364568 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 591/1192] 10.222.0.77 () {58 vars in 1254 bytes} [Mon Aug 29 22:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1741155288 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:55:52.260540 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:52.261114 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:52.263611 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:55:52.263760 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Mon Aug 29 22:55:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 (ip 10.222.0.77) !!! Aug 29 22:55:52.266405 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:52.267651 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG dbcounter [-] [148456] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=148456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:52.273076 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6", "tag": "785e7f22-36b3-4a26-9362-7942d91504b7"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:52.279570 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_api:SELECT=8 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:52.280480 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG dbcounter [-] [148457] Writing DB stats nova_cell1:SELECT=12 {{(pid=148457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:52.288086 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.288573 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.289035 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.297559 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.298195 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.298635 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.299522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.300416 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.301015 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.302467 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] Creating event network-changed:785e7f22-36b3-4a26-9362-7942d91504b7 for instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 on hv-cinder-85427 Aug 29 22:55:52.308182 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-d7c60d55-6d9a-43e3-990f-7ada73f3921b req-bce21eb3-5b94-4b17-8f0b-fcbea43e2654 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052551 Aug 29 22:55:52.308778 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 592/1193] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:52.329164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:55:52.419131 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1bad9a6e-7b22-4a51-a275-410b1907a7d4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 204 len: 0 microversion: 2.1 time: 0.165918 Aug 29 22:55:52.423856 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 602/1194] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:55:52 2022] DELETE /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:55:52.429534 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:52.430503 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:52.437107 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.437879 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.438309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.439238 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.439723 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.440160 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.817817 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:52.826449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-e3acb19a-5d29-456e-94e4-97189dc94705 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1574 microversion: 2.1 time: 0.401208 Aug 29 22:55:52.827166 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 593/1195] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:52 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1574 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:53.849846 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:53.850576 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:53.856998 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.857475 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.857908 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.858598 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.859159 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.859587 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.079378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:54.087535 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-ad1903ea-cf7d-4fdc-8c5d-4d3f1895f1e3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1574 microversion: 2.1 time: 0.241784 Aug 29 22:55:54.088117 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 603/1196] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:53 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:54.418024 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6", "name": "network-vif-deleted", "tag": "785e7f22-36b3-4a26-9362-7942d91504b7"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:54.428402 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.428885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.429321 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.440961 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] Creating event network-vif-deleted:785e7f22-36b3-4a26-9362-7942d91504b7 for instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 on hv-cinder-85427 Aug 29 22:55:54.446656 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-bbbaf32c-9477-41bc-abd3-2662395edc63 req-11530e1e-6c0b-4627-81af-19e6ccd1a7bb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Aug 29 22:55:54.447324 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 594/1197] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:55.109696 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:55.110264 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:55.117809 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.118281 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.118772 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.119493 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.119953 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.120562 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.162890 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.163378 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.163805 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.164489 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lazy-loading 'fault' on Instance uuid b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:55.206428 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:55.214113 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-cbead1e1-87dc-4da6-84ba-a077c579697c tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 200 len: 1183 microversion: 2.1 time: 0.108290 Aug 29 22:55:55.214687 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 604/1198] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:55 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 1183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:56.237189 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:56.237885 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:56.244003 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.244484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.244917 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.245609 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.246089 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.246513 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.260053 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] HTTP exception thrown: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Request method failure captured: Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 HTTP/1.1 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUJXRUveNDYBMOeF0DzxKsLTiOLJ2M7NaJmvobXOF4voiWBy-HfILf1wNdCUI95tBku9SA-a8yUXRD5078i16mjqZMWJBcPu1WLreFq4T1DF0iVqiQfBLt_apM7F8_xUcbkF_bkdY8EseDWn7yXQ9nQLbQqVSlZ8HBWJH3cNpP0bOXs Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:55:56.261639 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/36e090f60dd244cea327de965ad9af13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_36e090f60dd244cea327de965ad9af13", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}] Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 1addff9d7c7348de827c4eba89d41660 Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. Aug 29 22:55:56.263484 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': 'b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6'} Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:56.264608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. Aug 29 22:55:56.266281 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:55:56.267938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Returning 404 to user: Instance b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:56.267938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-d200d58f-a853-48a6-9167-6262cae1a4f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6" status: 404 len: 111 microversion: 2.1 time: 0.031049 Aug 29 22:55:56.267938 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 595/1199] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:56 2022] GET /compute/v2.1/servers/b1f1b37d-e284-4b3b-b546-fbb2dffe1ba6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:59.336924 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:59.337499 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:59.339896 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167fe5d0-c858-41ff-94ea-02ee2efb1848", "tag": "d43fa887-48db-44e4-b027-1e329db78c04"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:59.344510 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.344981 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.345403 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.346852 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.347305 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.347940 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.351394 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.352608 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.353623 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.370454 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] Creating event network-changed:d43fa887-48db-44e4-b027-1e329db78c04 for instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 on hv-cinder-85427 Aug 29 22:55:59.376222 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-d50795b8-8c3a-408f-8274-55ab9d88a992 req-2c4b0b52-8dc8-4aa5-aa98-08c59cafbb02 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040553 Aug 29 22:55:59.376975 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 596/1200] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:59.377683 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Going to try to terminate instance {{(pid=148457) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:55:59.494320 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-2ac541b1-1f56-417b-bc4b-13b4252a1cf9 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "DELETE /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 204 len: 0 microversion: 2.1 time: 0.160465 Aug 29 22:55:59.495765 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 605/1201] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:55:59 2022] DELETE /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:55:59.507549 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:59.508709 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:59.516726 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.517596 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.518606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.519572 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.520031 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.520445 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.653449 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.policy [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:59.661395 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-091d1d87-2892-45fa-b08a-c7636ec014f8 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1576 microversion: 2.1 time: 0.159518 Aug 29 22:55:59.662217 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 597/1202] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:59 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:00.684522 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:00.685191 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:00.691670 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.692151 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.692586 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.693287 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.693740 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.694164 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.838332 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:00.846310 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-42555fc3-edd8-4f94-befd-6b9cc6a81641 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1576 microversion: 2.1 time: 0.166131 Aug 29 22:56:00.846883 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 606/1203] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:00 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:01.412833 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167fe5d0-c858-41ff-94ea-02ee2efb1848", "name": "network-vif-deleted", "tag": "d43fa887-48db-44e4-b027-1e329db78c04"}]} {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:01.423180 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.423691 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.424593 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.437705 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.compute.server_external_events [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] Creating event network-vif-deleted:d43fa887-48db-44e4-b027-1e329db78c04 for instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 on hv-cinder-85427 Aug 29 22:56:01.444544 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [req-b4f34c02-2b62-40ac-aad4-ba1ec3f9572b req-88cac599-cc1f-4e50-9ee1-ff26f5286ddb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036110 Aug 29 22:56:01.445738 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 598/1204] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:01.868270 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:01.869183 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:01.875780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.876153 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.876614 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.877312 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.877762 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.878180 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.913379 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.913857 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.914291 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.914755 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.objects.instance [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lazy-loading 'fault' on Instance uuid 167fe5d0-c858-41ff-94ea-02ee2efb1848 {{(pid=148457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:56:01.959600 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.policy [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1addff9d7c7348de827c4eba89d41660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e090f60dd244cea327de965ad9af13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=148457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:01.967780 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-487552d1-871f-4899-912c-77150551e6e4 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 200 len: 1230 microversion: 2.1 time: 0.103595 Aug 29 22:56:01.968355 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 607/1205] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:01 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:02.991606 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:02.992310 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 167fe5d0-c858-41ff-94ea-02ee2efb1848] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:02.998459 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:02.998986 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:02.999424 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.000113 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.000561 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.000985 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.014601 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] HTTP exception thrown: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Request method failure captured: Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 HTTP/1.1 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUJXRUveNDYBMOeF0DzxKsLTiOLJ2M7NaJmvobXOF4voiWBy-HfILf1wNdCUI95tBku9SA-a8yUXRD5078i16mjqZMWJBcPu1WLreFq4T1DF0iVqiQfBLt_apM7F8_xUcbkF_bkdY8EseDWn7yXQ9nQLbQqVSlZ8HBWJH3cNpP0bOXs Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:56:03.016231 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/36e090f60dd244cea327de965ad9af13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_36e090f60dd244cea327de965ad9af13", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}] Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 1addff9d7c7348de827c4eba89d41660 Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. Aug 29 22:56:03.017871 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '167fe5d0-c858-41ff-94ea-02ee2efb1848'} Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:56:03.018756 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. Aug 29 22:56:03.020164 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.021409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Returning 404 to user: Instance 167fe5d0-c858-41ff-94ea-02ee2efb1848 could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:56:03.021409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-09ac2a61-18d8-4873-93a7-2ee803248722 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 29 22:56:03.021409 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 599/1206] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:02 2022] GET /compute/v2.1/servers/167fe5d0-c858-41ff-94ea-02ee2efb1848 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:56:03.449968 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:03.450498 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.compute.api [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148457) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:03.457484 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.457962 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.458396 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.459186 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.459642 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.460070 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG oslo_concurrency.lockutils [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.476237 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.wsgi [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] HTTP exception thrown: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Request method failure captured: Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: request: DELETE /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac HTTP/1.1 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept: application/json Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Accept-Encoding: identity Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Connection: close Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Length: 0 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Content-Type: application/json Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Host: 10.222.0.77 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: Openstack-System-Scope: None Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: User-Agent: python-urllib3/1.26.12 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Auth-Token: gAAAAABjDUJXRUveNDYBMOeF0DzxKsLTiOLJ2M7NaJmvobXOF4voiWBy-HfILf1wNdCUI95tBku9SA-a8yUXRD5078i16mjqZMWJBcPu1WLreFq4T1DF0iVqiQfBLt_apM7F8_xUcbkF_bkdY8EseDWn7yXQ9nQLbQqVSlZ8HBWJH3cNpP0bOXs Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Id: None Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Domain-Name: None Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Identity-Status: Confirmed Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Is-Admin-Project: True Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Id: default Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Domain-Name: Default Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Project-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Role: reader,member Aug 29 22:56:03.477870 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Roles: reader,member Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/36e090f60dd244cea327de965ad9af13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_36e090f60dd244cea327de965ad9af13", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}] Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Id: default Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Domain-Name: Default Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Id: 1addff9d7c7348de827c4eba89d41660 Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: X-User-Name: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: method: > Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: exception: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.479582 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: action_args: {'id': '0919031f-4373-45d3-b94e-29635868fcac'} Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:56:03.480419 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.481775 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.483260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Returning 404 to user: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. {{(pid=148457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:56:03.483260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-1d24fdf7-1be1-4819-b751-225c2f18a0f3 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 404 len: 111 microversion: 2.1 time: 0.033217 Aug 29 22:56:03.483260 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 608/1207] 10.222.0.77 () {58 vars in 1239 bytes} [Mon Aug 29 22:56:03 2022] DELETE /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:56:03.487912 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '>' {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:03.488524 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.compute.api [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] [instance: 0919031f-4373-45d3-b94e-29635868fcac] Fetching instance by UUID {{(pid=148456) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:03.494643 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.495480 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.496055 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.496901 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Acquiring lock "bfd9c997-d887-4047-b0a0-688098ec2707" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.497438 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.497899 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG oslo_concurrency.lockutils [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Lock "bfd9c997-d887-4047-b0a0-688098ec2707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=148456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.511171 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.wsgi [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] HTTP exception thrown: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Request method failure captured: Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: request: GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac HTTP/1.1 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept: application/json Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Accept-Encoding: identity Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Connection: close Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Length: 0 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Content-Type: application/json Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Host: 10.222.0.77 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: Openstack-System-Scope: None Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: User-Agent: python-urllib3/1.26.12 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Auth-Token: gAAAAABjDUJXRUveNDYBMOeF0DzxKsLTiOLJ2M7NaJmvobXOF4voiWBy-HfILf1wNdCUI95tBku9SA-a8yUXRD5078i16mjqZMWJBcPu1WLreFq4T1DF0iVqiQfBLt_apM7F8_xUcbkF_bkdY8EseDWn7yXQ9nQLbQqVSlZ8HBWJH3cNpP0bOXs Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Id: None Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Domain-Name: None Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Identity-Status: Confirmed Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Is-Admin-Project: True Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Id: default Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Domain-Name: Default Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Project-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Role: reader,member Aug 29 22:56:03.512687 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Roles: reader,member Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/36e090f60dd244cea327de965ad9af13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_36e090f60dd244cea327de965ad9af13", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/36e090f60dd244cea327de965ad9af13"}]}] Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Id: 36e090f60dd244cea327de965ad9af13 Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724046597 Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Id: default Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Domain-Name: Default Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Id: 1addff9d7c7348de827c4eba89d41660 Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: X-User-Name: tempest-TestVolumeBootPattern-1724046597-project Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: method: > Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: exception: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.514548 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: action_args: {'id': '0919031f-4373-45d3-b94e-29635868fcac'} Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: {{(pid=148456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:56:03.515538 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. Aug 29 22:56:03.517309 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: ERROR nova.api.openstack.wsgi Aug 29 22:56:03.519344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: DEBUG nova.api.openstack.wsgi [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Returning 404 to user: Instance 0919031f-4373-45d3-b94e-29635868fcac could not be found. {{(pid=148456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:56:03.519344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: INFO nova.api.openstack.requestlog [None req-c9e5418f-0e57-4439-984d-21246cec3bfe tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac" status: 404 len: 111 microversion: 2.1 time: 0.030150 Aug 29 22:56:03.519344 dv-cinder-854270-4-iscsi devstack@n-api.service[148456]: [pid: 148456|app: 0|req: 600/1208] 10.222.0.77 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:03 2022] GET /compute/v2.1/servers/0919031f-4373-45d3-b94e-29635868fcac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:56:04.809365 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: DEBUG nova.api.openstack.wsgi [None req-11b02971-1df1-4154-b843-7b8449f01d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] Calling method '.version_select at 0x7f5cf6c50ee0>' {{(pid=148457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:04.833664 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: INFO nova.api.openstack.requestlog [None req-11b02971-1df1-4154-b843-7b8449f01d35 tempest-TestVolumeBootPattern-1724046597 tempest-TestVolumeBootPattern-1724046597-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-672647324" status: 202 len: 0 microversion: 2.1 time: 0.028422 Aug 29 22:56:04.834329 dv-cinder-854270-4-iscsi devstack@n-api.service[148457]: [pid: 148457|app: 0|req: 609/1209] 10.222.0.77 () {58 vars in 1260 bytes} [Mon Aug 29 22:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-672647324 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)